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Intervention Description 1 

Functional behavioral assessment (FBA) is an individualized prob- 
lem-solving process for addressing student problem behavior. An 
assessment is conducted to identify the purpose or function of a 
student’s problem behavior. This assessment process involves col- 
lecting information about the environmental conditions that precede 
the problem behavior and the subsequent rewards that reinforce the 
behavior. The information that is gathered is then used to identify and 
implement individualized interventions aimed at reducing problem 
behaviors and increasing positive behaviors. Accordingly, the studies 
evaluating FBA examine different FBA-based interventions identified 
for each student. FBA-based interventions can be used to address 
diverse problem behaviors, such as disruptive and off-task behaviors, 
noncompliance, and inappropriate social interactions. 

Research 2 

The What Works Clearinghouse (WWC) identified 1 7 studies of FBA- 
based interventions that both fall within the scope of the Children Identi- 
fied With or At Risk for an Emotional Disturbance topic area and meet 
WWC pilot single-case design standards. No studies meet WWC group 
design standards. Seven studies meet pilot single-case design standards 
without reservations, and 10 studies meet pilot single-case design stan- 
dards with reservations. Together, these single-case design studies 
included 39 children between 5 and 18 years old who are identified 
with or at risk for an emotional disturbance. 3 
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This intervention report presents 
findings from a systematic review of 
functional behavioral assessment-based 
interventions conducted using the WWC 
Procedures and Standards Handbook, 
version 3.0, and the Children Identified 
With or At Risk for an Emotional 
Disturbance review protocol, version 3.0. 


Threshold to include single-case design evidence in WWC effectiveness ratings 


All single-case design experiments presented in the same research article are characterized as one study. Results from single- 
case design studies contribute to the WWC effectiveness rating for an outcome domain only if the studies with outcomes in that 
domain meet a set of threshold criteria, reflecting replication across different studies, research teams, and cases. 

Specifically, these criteria are: (1) at least five studies that examine the intervention must meet WWC pilot single-case design 
standards without reservations or meet WWC pilot single-case design standards with reservations, and (2) the single-case 
design studies must be conducted by at least three different research teams with no overlapping authorship at three different 
institutions, and (3) the combined number of cases (i.e., participants, classrooms) must total at least 20. 

For more information, please refer to the Pilot Single-Case Design standards in Appendix E of the WWC Procedures and 
Standards Handbook (version 3.0) 
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The results from single-case design studies only affect the WWC effectiveness rating for an outcome domain if the 
studies with outcomes in that domain collectively meet a set of threshold criteria. (See the box above for the ratio- 
nale behind this threshold and a description of the criteria.) 

The evidence from single-case design studies of FBA-based interventions on children identified with or at risk for 
an emotional disturbance reaches the required threshold to include single-case design evidence in the effectiveness 
ratings for two outcome domain(s)— school engagement and problem behavior. The evidence from the single-case 
design studies for FBA-based interventions does not reach the threshold to include single-case design evidence in 
the effectiveness ratings for one outcome domain— social-emotional competence. 4 There were no studies that meet 
standards in the 1 3 other domains, so this intervention report does not report on the effectiveness of FBA-based 
interventions for those domains. 5 (See the Effectiveness Summary on p. 5 for further description of all domains.) 

Effectiveness 

FBA-based interventions were found to have potentially positive effects on school engagement and potentially 
positive effects on problem behavior for children identified with or at risk for an emotional disturbance based on 
evidence from single-case design studies. The evidence from the single-case design studies for FBA-based inter- 
ventions does not reach the threshold to include single-case design evidence in the effectiveness ratings for the 
social-emotional competence domain. 


Table 1. Summary of findings from single-case design studies 6 


Outcome domain 

Number of 
studies 

Number of 
research 
teams 

Number of 
cases 3 

Rating of 
effectiveness 

Percentage of SCD 
experiments 
demonstrating a 
positive effect (#) 

Percentage of SCD 
experiments 
demonstrating a 
negative effect (#) 

School engagement 

15 

7 

32 

Potentially positive 
effects 

74% 

(24/34) 

0% 

(0/34) 

Problem behavior 

8 

5 

21 

Potentially positive 
effects 

68% 

(17/25) 

0% 

(0/25) 

Social-emotional 

competence 

3 

2 

4 

na 

na 

na 


Table Notes: In single-case design research, a case, such as a student or classroom, is the unit of intervention administration and data analysis. An experiment is the examination 
of a single outcome measure repeatedly within and across different phases defined by the presence or absence of the intervention. There may be multiple experiments for a case if 
more than one outcome is examined, for example. All experiments within a research article comprise one single-case design study. For the social-emotional competence domain, 
the rating of effectiveness and percentage of single-case design experiments demonstrating a positive and negative effect are not applicable (na) because the studies with out- 
comes in this domain do not meet the threshold criteria to include single-case design evidence in the effectiveness ratings. SCD = single-case design. 
a In this intervention report, each case was a single student as opposed to a group of students, such as a classroom. 
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Intervention Information 

Background 

FBA is an individualized practice, based on operant conditioning that describes the relationship between antecedents 
(such as settings), behaviors, and consequences. Specific conditions or antecedents can be associated with a behav- 
ior, but they do not describe how that behavior is maintained. The operant learning perspective suggests that behav- 
iors are maintained by the consequences or functions of the behavior, such as reinforcement (Skinner, 1 953). 7 

FBA does not have a single developer that provides materials or guidance on carrying out the practice. Instead, 

FBA researchers have developed materials that other researchers and practitioners can use to gather information 
about the functional relationships between students’ behaviors and their environments, which inform the develop- 
ment of FBA-based interventions for individual students. Researchers have developed interview protocols, survey 
instruments, and observational tools to gather information about the functional relationships between students’ 
behaviors and their environments (Dunlap et al., 1993 8 ; Kern, Dunlap, Clarke, & Childs, 1994 s ; O’Neill et al., 1997 10 ). 
Guidance documents and tools to help organize FBA information and develop hypotheses are also available (Umb- 
reit, Ferro, Liaupsin, & Lane, 2007 11 ). 

Intervention details 

FBA is used by researchers and school staff in school-based settings to identify the function of an individual stu- 
dent’s problem behavior and select an intervention for that specific student. The focus when conducting FBA is on 
identifying student-specific social, affective, cognitive, and/or environmental factors associated with the occurrence 
(and non-occurrence) of specific behaviors. This broader perspective offers a better understanding of the function 
or purpose behind student behavior. Behavioral intervention plans based on an understanding of “why” a student 
misbehaves are extremely useful in addressing a wide range of problem behaviors. 

FBA involves several processes and methods to collect and analyze data. Indirect data collection involves reviews 
of existing behavioral records; the use of behavioral checklists or rating scales; and interviews or surveys with 
teachers, students, and other adults to identify the problem behavior, the context in which the behavior occurs, and 
perspectives on why the behavior occurs. Direct observation involves observing the student in the natural environ- 
ment to document the conditions that precede the behavior and the reinforcements for the behavior. Summarizing 
data involves developing an operational definition that summarizes the observed behavior; generating hypotheses 
about the behavior’s function; identifying contextual factors and reinforcements that can be manipulated by teach- 
ers; and then selecting or developing an intervention procedure based on this information. Functional analysis 
involves testing the hypotheses by using interventions to manipulate the environmental context and the reinforce- 
ment for behaviors, and then examining how these affect the behavior. Functional analysis uses a rigorous, experi- 
mental testing approach, incorporating single-case designs, to evaluate how interventions affect behavior. 

The studies in this report examine different FBA-based interventions identified for each student. The assessment 
process and resulting interventions are carried out and implemented with the individual student within the context 
of one-on-one teaching sessions, small groups, or a whole classroom. The Individuals with Disabilities Education 
Act (IDEA) requires the use of FBA and resulting FBA-based interventions to address behavioral problems that 
impede student learning in school settings. As a result, FBA is commonly used as part of the Individualized Educa- 
tion Program (IEP) development process after a child has been classified with an emotional disturbance. 


Cost 

Because FBA-based interventions are identified and selected based on an individual student’s problem behavior, 
information is not available about the costs of teacher training or implementation of FBA and the resulting FBA- 
based interventions. 
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Research Summary 


The WWC identified no eligible group design studies and 34 eligible 
single-case design studies that investigated the effects of FBA-based 
interventions on children identified with or at risk for an emotional 
disturbance. An additional 293 studies were identified but do not meet 
WWC eligibility criteria for review in this topic area. Citations for all 327 
studies are in the References section, which begins on p. 6. 


Table 2. Scope of reviewed research 


Grades 

K— 12 

Delivery method 

Individual 

Intervention type 

Practice 


The WWC reviewed the 34 single-case design studies against pilot single-case design standards. Seven studies 
meet pilot single-case design standards without reservations, and 10 studies meet pilot single-case design stan- 
dards with reservations. Those 17 studies are summarized in this report. The remaining 17 studies do not meet pilot 
single-case design standards. 


Sixteen of the 17 studies that meet pilot single-case design standards with or without reservations have at least 
one outcome in a domain that reaches the threshold for including single-case design evidence in the effectiveness 
ratings. Details on these studies are described in Appendices A-C. The remaining study that meets WWC pilot 
single-case design standards with or without reservations only has outcomes in a domain that does not reach the 
threshold for including single-case design evidence in the effectiveness ratings in this report; more details on this 
study can be found in Appendix D. 12 


Summary of studies meeting WWC pilot single-case design standards without reservations 

Seven studies have experiments that meet WWC pilot single-case design standards without reservations. 13 These 
experiments investigated the effects of FBA-based interventions on school engagement, problem behavior, and 
social-emotional competence outcomes. The experiments included children identified with or at risk for an emo- 
tional disturbance, ranging in age from 7 to 14 years old. Different FBA-based interventions were identified for each 
student and included approaches such as student self-monitoring, modifications to the proximity of peers and 
teachers, peer support, teacher attention, and modifications to assignments. Details on these studies are described 
in Appendices A-D. 


Summary of studies meeting WWC pilot single-case design standards with reservations 

Ten studies have experiments that meet WWC pilot single-case design standards with reservations. These experi- 
ments investigated the effects of FBA-based interventions on school engagement, problem behavior, and social- 
emotional competence outcomes. The experiments included children identified with or at risk for an emotional 
disturbance, ranging in age from 5 to 17 years old. Different FBA-based interventions were identified for each 
student, and included approaches such as teacher attention, modifications to the proximity of peers and teachers, 
reinforcement, and curricular modifications. Details on these studies are described in Appendices A-D. 
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Effectiveness Summary 

The WWC review of FBA-based interventions for the Children Identified With or At Risk for an Emotional Disturbance 
topic area includes student outcomes in 16 domains: alphabetics, communication/language competencies, com- 
munity, general reading achievement, math achievement, problem behavior, reading comprehension, reading fluency, 
school engagement, science achievement, self-care/daily living, self-determination, social-emotional competence, 
social studies achievement, vocational/occupational, and writing achievement. 

The 17 studies of FBA-based interventions that meet WWC pilot single-case design standards reported findings in 
three of the 16 domains: (a) school engagement, (b) problem behavior, and (c) social-emotional competence. Effec- 
tiveness ratings of FBA-based interventions on children identified with or at risk for an emotional disturbance are 
presented for two of the three domains (school engagement and problem behavior). The findings from the social- 
emotional competence domain do not meet the threshold to include single-case design evidence in the effectiveness 
ratings in this report. 12 For a more detailed description of the rating of effectiveness for single-case design studies 
and extent of evidence criteria, see the WWC Rating Criteria on p. 67. 

In each of these studies, FBA was used by researchers and school staff to identify the function of at least one stu- 
dent’s problem behavior and select an intervention for each child. Accordingly, the FBA-based interventions for each 
student did vary. 

Summary of effectiveness for the school engagement domain 


Table 3. Rating of effectiveness for single-case design studies for the school engagement domain 


Rating of effectiveness 

Criteria met 

Potentially positive effects 

Evidence of a positive 
effect with no overriding 
contrary evidence. 

Across the 34 single-case design experiments for the school engagement domain, 25 experiments (74%) 
documented a positive effect and 0 experiments documented a negative effect. 


Fifteen studies that meet WWC pilot single-case design standards with or without reservations reported findings in the 
school engagement domain. Author-reported findings for each study are reported in Appendix A. The results of the 
WWC’s visual analysis of each single-case design experiment are reported in Appendix C. Across the 34 single-case 
design experiments, 25 experiments (74%) documented a positive effect, and no single-case design experiments 
documented a negative effect. This results in a rating of potentially positive effects for the school engagement domain. 


Summary of effectiveness for the problem behavior domain 

Table 4. Rating of effectiveness for single-case design studies for the problem behavior domain 


Rating of effectiveness 

Criteria met 

Potentially positive effects 

Evidence of a positive 
effect with no overriding 
contrary evidence. 

Across the 25 single-case design experiments for the problem behavior domain, 17 experiments (68%) 
documented a positive effect and 0 experiments documented a negative effect. 


Eight studies that meet WWC pilot single-case design standards with or without reservations reported findings in 
the problem behavior domain. Author-reported findings for each study are reported in Appendix A. The results of the 
WWC’s visual analysis of each single-case design experiment are reported in Appendix C. Across the 25 single-case 
design experiments, 17 experiments (68%) documented a positive effect, and no single-case design experiments 
documented a negative effect. This results in a rating of potentially positive effects for the problem behavior domain. 
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Appendix A.1: Research details for Christensen et al. (2004) 

Christensen, L., Young, K. R., & Marchant, M. (2004). The effects of a peer-mediated positive behavior 
support program on socially appropriate classroom behavior. Education and Treatment of Chil- 
dren, 27(3), 199-234. 


Setting 

The study was conducted in an urban elementary school. The school’s student population was 
53% Caucasian, 40% Hispanic, and 7% other ethnicity; 67% of the students qualified for free 
or reduced-price lunch. Eduardo’s intervention took place in a third-grade general education 
classroom with 23 students. 15 

Study sample 

The study sample included two 8-year-old boys, Eduardo and Justin, who were determined to 
be at risk for an emotional and behavioral disorder. Eduardo demonstrated high rates of disrup- 
tive and off-task behavior in the classroom. He had recently arrived at the school from Ecuador, 
but spoke English and no longer qualified for English as a second language services. He per- 
formed below grade level in math and reading and received daily tutoring in those subjects. 

The experiment for Justin did not meet WWC pilot single-case design standards because it 
does not include at least three attempts to demonstrate an intervention effect at three dif- 
ferent points in time; thus, this experiment is not described in this report or included in the 
ratings of effectiveness. 

Intervention 

Functional behavioral assessment (FBA) procedures, including a teacher interview, observa- 
tions conducted across different academic subject times, identification of problem behaviors 
and alternative positive behaviors, and a survey to identify potential reinforcers, determined 
that Eduardo’s problem behavior was caused by the lack of attention he received in his class- 
room. Specifically, there was a low rate of reinforcement, especially attention-based reinforce- 
ment by the teacher and peers, for appropriate behavior. The study examined the effects of 
an individualized FBA-based intervention called Positive Behavior Support that was directly 
aligned to Eduardo’s needs and included self-monitoring, peer and teacher support and atten- 
tion, and reinforcement for appropriate behavior, using tokens and praise. 

Comparison 

The study used a reversal-withdrawal design. During the baseline/withdrawal condition, there 
was no formal behavior management system in place in the classroom. Observations revealed 
that the teacher would occasionally praise students or call out to the class that they were 
doing well. Consequences for inappropriate behavior were inconsistent. 

Outcomes and 
measurement 

The outcome was the percentage of intervals with socially-appropriate classroom behavior 
which falls under the school engagement domain. For a more detailed description of this out- 
come measure, see Appendix B. 

Results from the one experiment with an outcome in the school engagement domain are pre- 
sented in Appendix C.1 . 
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Support for 

Eduardo’s classroom teacher was trained by a behavior specialist, who presented an overview 

implementation 

of the intervention plan and the role of the peer partner. The teacher also learned about the 
process for providing reinforcement and praise. Eduardo’s teacher then trained the student 
pair (Eduardo and his peer) in her class, through two 1-hour sessions. A training checklist was 
used by the teacher to verify the mastery of items. 

Maintenance 

There was no maintenance phase. 

Author-reported 

findings 

The study authors found that the FBA-based intervention increased Eduardo’s socially appro- 
priate classroom behavior. The results of WWC’s corresponding visual analysis are presented 
in Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards Without Reservations. 


Appendix A.2: Research details for Hagan-Burke et al. (2015) 

Hagan-Burke, S., Gilmour, M. W., Gerow, S., & Crowder, W. C. (2015). Identifying academic demands 
that occasion problem behaviors for students with behavioral disorders: Illustrations at the ele- 
mentary school level. Behavior Modification, 39(1), 215-241. 


Setting 

The study took place in a public elementary school in a suburban area. It was a Title 1 school 


with grades pre-K through fifth grade. At least 90% of students in the school received free or 
reduced-price lunch; the ethnicity of the school population was 71 % African American, 20% 
Hispanic, 4% multi-racial, 3% Caucasian, and 2% Asian American. The intervention sessions 
took place in the participants’ special education classrooms. 

Study sample 

Two students were referred to the school’s behavior support team for problem behaviors that 
were associated with academic performance. The first student, Freddy, was a first-grade 
(age 7) Hispanic student with a behavior disorder and Attention Deficit Hyperactivity Disorder. 
Freddy spent approximately one-third of the school day in a special education classroom 
receiving social behavior support, along with academic support for reading and math. The 
second student, Clay, was a third-grade (age 9) African-American student with a behavior 
disorder. His special education services were provided 90 minutes per day and included social 
behavior support, along with academic support for reading, spelling, and math. 

Intervention 

Functional behavioral assessment (FBA) procedures for each student included interviewing the 
participants’ teachers, examining records of discipline referrals, and conducting direct obser- 
vations in the students’ general and special education classrooms. After coding the direct 
observation data and identifying potential triggers, the researchers conducted a structural 
analysis for each participant to determine the contextual variables (e.g., classroom climate) 
associated with each student’s behaviors. 
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Comparison 


Outcomes and 
measurement 


Support for 
implementation 

Maintenance 

Author-reported 

findings 

WWC study rating 


The researchers determined that Freddy was most likely to exhibit decreased task engage- 
ment during circle time, when activities used a choral response format with fast-paced instruc- 
tion, as opposed to an independent work setting, where his task engagement was higher. As 
a result, the FBA-based intervention that was developed used slow-paced instruction during 
circle time. The researchers held constant the choral group leader, the length of each session, 
and the approximate number of peers present. They asked the teacher to only praise or give 
affirmation statements to Freddy after each session had ended. 

For Clay, the researchers examined his behavior across four content areas and determined 
that independent math work with unknown multiplication facts was associated with his 
decreased task engagement. The FBA-based intervention that was developed provided Clay 
with a worksheet consisting of multiplication problems using known facts. The length of ses- 
sions, number of problems per worksheet, and total number of digits per worksheet were con- 
trolled; order effects were controlled by counterbalancing conditions. The researchers made 
sure that the teacher was blind to which condition was in effect and asked the teacher to use 
the same interaction level and type as she typically would when Clay was engaged in indepen- 
dent academic work. 

The study used an alternating treatment design for both participants. Freddy’s alternating 
treatment design compared the effect of using slow-paced instruction (FBA-based interven- 
tion) to fast-paced instruction (comparison). Clay’s alternating treatment design compared the 
effect of using known multiplication problems (FBA-based intervention) with unknown multipli- 
cation problems (comparison). The FBA conducted prior to intervention documented that both 
participants engaged in high levels of baseline problem behavior during specific times in the 
academic day. 

The outcome for both students was appropriate task engagement, which falls within the 
school engagement domain. For a more detailed description of this outcome measure, see 
Appendix B. The study also measured the percentage of math problems Clay solved correctly; 
this outcome is not eligible for review, as it does not pertain to the overall purpose of the study 
(i.e., examining the effect of FBA procedures in developing interventions to improve academic 
task engagement), but instead measures intervention fidelity. 

Results from the two experiments with outcomes in the school engagement domain are pre- 
sented in Appendix C.1 . 

The researchers observed Freddy’s teacher to document that she followed the correct pace. 

They also asked Freddy’s teacher to follow a prescribed way to deliver praise, but they did not 
describe how they trained her. The researchers instructed Clay’s teacher to maintain the same 
level of interactions she typically had with Clay during independent work across both conditions. 

There was no maintenance phase. 

The study authors found that the FBA-based interventions increased appropriate task engage- 
ment for Freddy and Clay. The results of WWC’s corresponding visual analysis are presented 
in Appendix C. 

Meets WWC Pilot Single-Case Design Standards Without Reservations. 16 
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Appendix A.3: Research details for Hansen et al. (2014) 

Hansen, B. D., Wills, H. P., Kamps, D. M., & Greenwood, C. R. (2014). The effects of function-based 
self-management interventions. Journal of Emotional and Behavioral Disorders, 22(3), 149-159. 
doi:1 0. 1 1 77/1 063476345 


Setting The study took place in three classrooms in a school in a large urban area in the Midwest. The 
school had 460 students in grades 1-6 and served more than 72% economically disadvan- 
taged students. Isaac was taught exclusively in a special education classroom with one or two 
adults, and Jeremiah and Ben were taught in general education classes, with paraprofessional 
support. The study intervention took place in the class where each student had the most 
behavior problems: math for Isaac and Ben, and writing for Jeremiah. 

Study sample Three students were part of the study sample. Isaac was a 12-year-old Caucasian male who 
spoke English at home. He was in sixth grade but tested at least three grades below his age 
level and tested in the mild intellectual disability range (IQ = 67). He was in a school-based 
program for children with an emotional and behavioral disorder (EBD) and had been in the self- 
contained special education classroom since first grade, spending more than half of the day 
with one or two adults and no peers. 

Jeremiah was a 7-year-old Caucasian male who spoke English at home. He was in second 
grade, tested slightly below grade level in all academic areas, and had average cognitive skills. 
He was in a school-based program for children with EBD, had a health impairment, and spent 
most of the day in a general education classroom with support from paraprofessionals. 

Ben was a 9-year-old Caucasian male who spoke English at home. He was in third grade and had 
an IQ of 94. He was in a school-based program for children with EBD, and had previously been 
in a self-contained special education classroom under the category of developmental delay. He 
spent most of his day in a general education classroom with support from paraprofessionals. 

Intervention Functional behavioral assessment (FBA) procedures for each student included interviewing the 
participants’ teachers, examining records of discipline referrals, and conducting direct obser- 
vations in the students’ classrooms. FBA indicated that Isaac’s and Ben’s disruptive behaviors 
were maintained by escape from academic demands, and that Jeremiah was disruptive to 
obtain peer attention. 

The FBA-based intervention for all three students, functional based self-management (FBSM), 
included a system of consequences and rewards. The student observed and recorded his own 
problem behavior and received consequences and/or rewards, depending on whether they 
met the goal they were monitoring. The rewards for appropriate behavior were “break tickets,” 
which could be used for a 1 -minute break from instruction or a 1 -minute break with a friend. 
The consequences for negative behaviors were prompts for getting back on task. The FBA- 
based intervention also included self-monitoring (see summary in the comparison description). 


Comparison The study used a reversal-withdrawal design for all three students. During the baseline/with- 
drawal condition, students used self-monitoring techniques. The teacher asked the student to 
set a goal for a 5-minute period. After 5 minutes had passed, the student would note whether 
he was on task. At the end of the lesson, the student tallied the number of times he was on 
task. Isaac and Ben’s teachers could use prompts for on-task behavior; but all three teachers 
were told to limit attention to positive behaviors. 
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Outcomes and 
measurement 

The study included direct observations of on-task behavior, which falls in the school engage- 
ment domain, and disruptive behavior, which falls in the problem behavior domain. Observ- 
ers were trained to use the Multiple Option Observation System for Experimental Studies 
(MOOSES; Tapp, Wehby, & Ellis, 1995) 17 for recording of the behavioral measures. For a more 
detailed description of these outcome measures, see Appendix B. 

Results from the three experiments with outcomes in the school engagement domain are 
presented in Appendix C.l. Results from the three experiments with outcomes in the problem 
behavior domain are presented in Appendix C.2. 

Support for 
implementation 

The researchers trained the teachers on the self-monitoring component, provided a protocol, 
and trained teachers on how to use consequences for appropriate and disruptive behavior. 

Maintenance 

There was no maintenance phase. 

Author-reported 

findings 

The study authors found that FBA-based interventions— and more specifically, FBSM — led to 
increases in on-task behavior and substantial decreases in disruptive behavior for Isaac, Jere- 
miah, and Ben. The results of WWC’s corresponding visual analysis are presented in Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards Without Reservations. 18 


Appendix A.4: Research details for Kern et al. (1994) 

Kern, L., Childs, K. E., Dunlap, G., Clarke, S., & Falk, G. D. (1994). Using assessment-based curricular 
intervention to improve the classroom behavior of a student with emotional and behavioral chal- 
lenges. Journal of Applied Behavior Analysis, 27(1), 7-19. 


Setting 

The study focused on one student but took place in three of his special education classrooms 


(spelling, English, and math). Each classroom had a teacher, aide, and about eight other stu- 
dents who were severely emotionally disturbed. 

Study sample 

The study focused on one student, Eddie, who was an 1 1 -year-old male in fifth grade. He had 
high-average intelligence, performing at or above grade level in all subjects. He had problems with 
on-task behavior and frequently had disruptive behavior, including tantrums and occasional 
self-injury. His special education program served students described as severely emotionally 
disturbed. 

Intervention 

Functional behavioral assessment (FBA) procedures included direct observations of Eddie 
throughout the school day, interviews with Eddie and his teachers, and standardized test 
results. Based on initial observations, the researchers hypothesized that Eddie’s problem behav- 
ior occurred when he was trying to escape academic tasks and expectations. Using the results 
from additional FBA observations conducted during academic sessions, researchers worked 
with teachers to select three curricular modifications. All of the teachers included shorter 
assignments and self-monitoring as the FBA-based intervention. In math, the intervention also 
included reducing the number of drills (they were replaced with problem-solving activities), and 
in English and spelling, the teachers allowed Eddie to complete some work in a mode other 
than handwriting. 
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Comparison 

The study used one multiple baseline design experiment across three subjects. The baseline 


condition consisted of normal classroom practice without self-monitoring. Students mostly 
completed independent work, although teachers would also sometimes lecture; a classroom- 
wide behavior management system was in place, and good behavior was rewarded with points 
that could be exchanged for prizes. Normal instruction included shortening required work for 
Eddie. His teachers believed that shortening work had reduced Eddie’s tantrums, but he still 
did not complete his work. 

Outcomes and 
measurement 

The study’s outcome was on-task behavior, which falls in the school engagement domain. 

For a more detailed description of this outcome measure, see Appendix B. 

Results from the one experiment with an outcome in the school engagement domain are pre- 
sented in Appendix C.1 . 

Support for 
implementation 

Not reported. 

Maintenance 

There was an 8-week follow-up phase, with four data points in each classroom. The pro- 
cedures were the same as the intervention stage, except that self-monitoring was phased 
out, and Eddie was monitored for on-task behavior during 5-minute intervals, rather than the 

1 -minute intervals used in the intervention. The data patterns during the follow-up phase were 
similar to the patterns in the intervention phase in each classroom. 

Author-reported 

findings 

The study authors found that the FBA-based intervention increased Eddie’s on-task behavior. 

The results of WWC’s corresponding visual analysis are presented in Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards Without Reservations. 


Appendix A.5: Research details for Lane et al. (2007a) 

Lane, K. L., Rogers, L. A., Parks, R. J., Weisenbach, J. L., Mau, A. C., Merwin, M. T., & Bergman, W. A. 
(2007a). Function-based interventions for students who are nonresponsive to primary and secondary 
prevention efforts: Illustrations at the elementary and middle school levels. Journal of Emotional 
and Behavioral Disorders, 15(3), 169-183. 


Setting 

The study took place in an eighth-grade science class in a rural Tennessee school district. 

Study sample 

The district subscribed to a full inclusion model, and the schools used a three-tiered model 
of Positive Behavior Support (PBS). 

Two students were part of the study sample. Aaron was a 14-year-old male in eighth grade 
who had antisocial behavior and was at risk for an emotional and behavioral disorder clas- 
sification. In the classroom, Aaron was highly noncompliant and also demonstrated impaired 
relationships with peers, a negative attitude, many problem behaviors, and poor academic 
achievement. Aaron had received special education services since fourth grade for a learning 
disability in written expression. 
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The other student in the study sample was Claire; the authors used a changing criterion 
design to study the effects of FBA and the resulting FBA-based intervention on Claire’s social- 
emotional outcome (classroom participation). This experiment meets WWC pilot single-case 
design standards without reservations; however, the social-emotional competence domain 
does not reach the threshold to include single-case design evidence in the effectiveness 
ratings in this report, so her experiment is not described in Appendix C. For a more detailed 
description of Claire’s experiment, see Appendix D. 12 

Intervention 

Functional behavioral assessment (FBA) procedures, including teacher and parent interviews, 
behavior rating scales completed by teachers, and direct observations, determined that Aaron 
engaged in noncompliance to increase teacher attention and escape assigned tasks. Aaron’s 
FBA-based intervention involved providing him with a checklist of tasks to complete when 
responding to questions or assignments shown on the classroom work board. The teacher and 
special education aide in Aaron’s classroom gave positive reinforcement only after Aaron had 
successfully completed the work board assignment and the checklist. When Aaron exhibited the 
target behavior, the teacher or assistant gave a verbal redirect lasting no longer than 2 seconds; all 
other attention was withheld until Aaron had completed his work board assignment and checklist. 

Comparison 

The study used a reversal-withdrawal design for Aaron. The baseline/withdrawal sessions took 
place in Aaron’s classroom and consisted of regular classroom practices. 

Outcomes and 
measurement 

Aaron’s outcome is the percentage of intervals in which he demonstrated compliance with the 
teacher, which falls under the school engagement domain. For a more detailed description of 
this outcome measure, see Appendix B. 

The study also measured the social validity of the intervention via student and teacher rat- 
ings. These outcomes are not presented in the report because they do not fall under a domain 
specified in the protocol. 

Results from the one experiment with an outcome in the school engagement domain are pre- 
sented in Appendix C.1 . 

Support for 
implementation 

Researchers provided Aaron’s teacher with training about the specific components of the 
intervention, including the reinforcements, and how each of the components was to be imple- 
mented correctly. Aaron’s teacher agreed to provide the checklist each day and sign the 
checklist following Aaron’s completion of tasks. 

Maintenance 

For Aaron, maintenance data were collected 7 weeks after intervention completion. At that 
time, Aaron’s teacher had discontinued the use of Aaron’s checklist and restructured the work 
board activity for the entire class. She continued to give Aaron extra points for successful 
completion of work board assignments but did not give him opportunities to choose peers 
for group work and did not record whether she only gave him attention for compliant behavior. 
There was a downward trend in Aaron’s compliance, and it was at a level similar to the 
withdrawal phase. 

Author-reported 

findings 

The study authors found that the FBA-based intervention increased Aaron’s compliance 

with the teacher. The results of WWC’s corresponding visual analysis are presented in Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards Without Reservations. 19 
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Appendix A.6: Research details for Lane et al. (2007b) 

Lane, K. L., Weisenbach, J. L., Phillips, A., & Wehby, J. H. (2007). Designing, implementing, and evalu- 
ating function-based interventions using a systematic, feasible approach. Behavioral Disorders, 
32(2), 122-139. 


Setting 

The study took place in an inclusive public school in Tennessee. Charlie was in a first-grade 


classroom that was taught by a teacher who had 6 years of experience and a master’s degree. 
Margaret was in a second-grade classroom that was taught by a first-year teacher with a 
bachelor’s degree. 

Study sample 

Two students were part of the study sample. Charlie was a 7-year-old student who was at risk for 
emotional and behavioral problems, according to his teacher’s assessment on the Student Risk 
Screening Scale (SRSS). He did not receive special education services at the time of the study. 

Another participant, Margaret, only had measured outcomes in the social-emotional com- 
petence domain. The social-emotional competence domain does not reach the threshold to 
include single-case design evidence in the effectiveness ratings in this report, so her experi- 
ment is not described in Appendix C. For a more detailed description of Margaret’s experi- 
ment, see Appendix D. 12 

Intervention 

Functional behavioral assessment (FBA) procedures, including teacher and parent interviews, 
direct observations, and behavioral rating scales, suggested that Charlie engaged in off-task 
behavior to attract teacher and peer attention and escape from nonpreferred activities. The 
resulting FBA-based interventions involved: a) teaching the student a replacement behavior; b) 
restructuring the environment, if needed; or c) restructuring the contingencies surrounding the 
behavior. If Charlie succeeded in only demonstrating off-task behaviors that were within the 
daily limit (initially four, then increased to eight per day) and completed all of his assignments 
with 100% accuracy, he was allowed access to additional activities, such as a weekly trip to 
the library. Charlie’s teacher would praise his positive behavior throughout the day, and send 
notes to his parents about his performance which allowed them to provide positive reinforce- 
ment at home. When Charlie engaged in off-task behavior, the teacher gave brief verbal redi- 
rection and placed a tally mark on the chalkboard. 

Comparison 

The study used a reversal-withdrawal design for Charlie. During the baseline/withdrawal ses- 
sions, regular classroom practices were implemented in a 90-minute period in the morning. In 
that period, students were to complete three “center” assignments, while the teacher met with 
each reading group for 30 minutes. Students sat in groups of four and were allowed to talk 
quietly if they needed help completing the assignments. If a student exhibited negative behavior, 
the student had to “move their star” that was visible by the classroom; as the stars moved 
downward, privileges were lost. 

Outcomes and 
measurement 

The outcome for Charlie was off-task behavior, which falls under the school engagement 
domain. For a more detailed description of this outcome measure, see Appendix B. 

Results from the one experiment with an outcome in the school engagement domain are pre- 
sented in Appendix C.1 . 
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Support for 

The primary investigator trained the teacher to implement the intervention during 6 hours of 

implementation 

staff development over the summer. The content focused on the principles of applied behavior 
analysis and how to design, implement, and evaluate a function-based intervention. During the 
course of the academic year, teachers had weekly contact (1 hour) with their project liaison to 
reinforce and re-teach the procedures addressed during the initial training. 

Maintenance 

There was no maintenance phase. 

Author-reported 

findings 

The study authors found that the FBA-based intervention decreased the level of off-task 
behavior for Charlie. The results of WWC’s corresponding visual analysis are presented in 
Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards Without Reservations. 20 


Appendix A.7: Research details for Losinski et al. (2015) 

Losinski, M. L., Maag, J. W., Katsiyannis, A., & Ryan, J. B. (2015). The use of structural behavioral 
assessment to develop interventions for secondary students exhibiting challenging behaviors. 
Education and Treatment of Children, 38(2), 1-26. 


Setting 

The study took place in a rural, public middle school in the southeastern United States. The 

Study sample 

same reading and language arts teacher delivered the intervention to all four students in an 
eighth-grade general education classroom. Alexandra received instruction in one class, and 
the other three students (Brenda, Hannah, and Larry) were in the other class together. The 
intervention conditions were manipulated for these three students simultaneously. 

Four students were part of the study sample. Alexandra and Brenda were both 1 3-year-old 
Caucasian females. Hannah was a bi-racial (Caucasian and African-American) 13-year-old 
female, and Larry was a 14-year-old African-American male. None of the students received 
any special education or related services at the time of the study, but all four students were at 
high risk of future anti-social behaviors. Alexandra demonstrated excessive lying and problem 
behaviors and had a negative attitude that frequently disrupted the learning of others. Brenda 
exhibited disruptive behaviors and a negative attitude, failed to complete assignments, was 
often non-compliant, and had low-academic performance, despite previous participation in a 
program for gifted and talented students. Hannah was frequently aggressive with peers, had 
behavior problems, frequently lied, and had a negative attitude. Larry received poor grades, had 
a generally negative attitude, and was prone to behavior problems including lying and aggres- 
sion towards peers. Alexandra, Hannah, and Larry were eligible to receive free or reduced-price 
school meals. 
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Intervention 


Comparison 


Outcomes and 
measurement 


Support for 
implementation 


Maintenance 


This study used alternating treatment design experiments to explore the effect of interventions 
based on structural behavior assessment, which is a type of functional behavioral assessment 
(FBA) that focuses on the relationships between contextual variables (e.g., classroom climate) 
and subsequent behaviors; assessments were used to form hypotheses and design indi- 
vidualized interventions that change contextual factors. The FBA included reviewing student 
records, conducting structured and unstructured interviews with teachers, and completing a 
rating scale. According to interviews, the students’ disruptive behaviors were most likely to 
occur if students were sitting next to a preferred peer, and least likely to occur when engaged 
with the teacher. Based on these findings, two FBA-based interventions were developed for 
each student: (1) proximity to teacher (within eight feet of the student), and (2) separation from 
preferred peer (seated in a non-adjacent seat more than eight feet away). During the alternat- 
ing treatment design experiments, three conditions (baseline, proximity to teacher, and sepa- 
ration from preferred peer) were each introduced once per day, over 5 consecutive days. The 
researcher prompted the teacher each time a condition was to change. 

This study used alternating treatment design experiments for all four students. During the 
comparison condition, the teacher made no particular effort to stand near the sample students 
or separate them from preferred peers, so proximity was not controlled. Based on classroom 
recordings from baseline, it was clear that teachers and preferred peers were not routinely in 
close proximity of target students. 

The outcomes for all four students were academic engagement, which falls within the school 
engagement domain, and disruptive behavior, which falls within the problem behavior domain. 
For a more detailed description of these outcome measures, see Appendix B. 

Results from the eight experiments with outcomes in the school engagement domain are 
presented in Appendix C.l. Results from the eight experiments with outcomes in the problem 
behavior domain are presented in Appendix C.2. 

The students’ regular classroom teacher conducted the instruction in both the baseline and 
intervention conditions. The researcher provided a preset device that discreetly prompted the 
teacher when it was time to change conditions. The researcher also developed a procedural 
reliability checklist to measure the fidelity of each intervention. 

There was no maintenance phase. The study included a third phase during which the inter- 
vention condition determined to work best (the separation from preferred peer condition) was 
continued. Overall, all four students demonstrated less disruptive behavior and higher levels of 
academic engagement during this phase, compared to baseline. For two students (Alexandra 
and Brenda), the patterns during this phase showed greater variability than during the inter- 
vention phase of the study; for the other two students, less variability was observed during this 
final phase. 
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Author-reported 

findings 

The study authors found that both FBA-based interventions — peer separation and teacher 
proximity— were associated with some increases in academic engagement, but peer sepa- 
ration had a larger impact. The author findings varied by student. For Alexandra, the study 
authors found that both peer separation and teacher proximity were associated with an 
increase in academic engagement, but peer separation had a larger impact. For Brenda, 
the study authors found that peer separation was associated with an increase in academic 
engagement, but teacher proximity had no positive effect on academic engagement. For Han- 
nah, the study authors found that peer separation and teacher proximity were both associated 
with an increase in academic engagement. For Larry, the study authors found that peer sepa- 
ration was associated with an increase in academic engagement, but that teacher proximity 
was associated with a slight decrease in academic engagement. 

The study authors found that both FBA-based interventions — peer separation and teacher 
proximity— were associated with decreases in all four students’ disruptive behavior, but peer 
separation had a larger impact. The author findings varied by student. For Alexandra, the 
study authors found that both peer separation and teacher proximity were associated with 
a decrease in disruptive behavior, but peer separation had a larger impact. For Brenda, the 
study authors found that both peer separation and teacher proximity were associated with a 
decrease in disruptive behavior. For Hannah, the study authors found that peer separation was 
associated with a large decrease in disruptive behavior, and teacher proximity was associ- 
ated with a slight decrease in disruptive behavior. For Larry, the study authors found that peer 
separation was associated with a large decrease in disruptive behavior and teacher proximity 
was associated with a slight decrease in disruptive behavior. 

The results of WWC’s corresponding visual analysis are presented in Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards Without Reservations. 


Appendix A.8: Research details for Christensen et al. (2012) 

Christensen, L., Renshaw, T. L., Caldarella, P., & Young, J. R. (2012). Training a general educator to use 
function-based support for students at risk for behavior disorders. Education, 133(2), 313-335. 


Setting 

The study took place in a Title 1 elementary school in a suburban area of Utah. Approximately 

Study sample 

74% of the students in the school were Caucasian, 22% were Hispanic, and 4% identified as 
other ethnic groups. Both participants were taught in a general education classroom in by a 
fourth-grade teacher who had a bachelor’s degree in elementary education. 

The study includes three students who were identified by their teacher as being at risk for 
behavioral disorders. Amy was a fourth-grade Caucasian female student who performed above 
grade level in reading and mathematics. Jose was a fourth-grade Puerto-Rican/Caucasian male 
student who performed at grade level in reading and mathematics. Both students were at risk 
for future academic difficulties because of frequent disengagement from academic tasks. 

The single-case design experiment for an additional student, Cameron, does not meet WWC 
pilot single-case design standards because data are only presented for two phases; therefore, 
there is not an attempt to demonstrate the effect of the intervention three times. As a result, 
this experiment is not described in this report or included in the ratings of effectiveness. 
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Intervention 

Following training provided by the research staff, the teacher carried out a functional behav- 
ioral assessment (FBA), which included direct observations of the students. The teacher then 
developed FBA-based interventions for both students. Amy’s intervention involved self- 
management training, extra teacher attention, and the use of tokens she could exchange for 
extra reading time, if she stayed seated and worked on assigned material. Jose’s intervention 
involved giving him tokens that he could exchange for extra recess time, if he demonstrated 
on-task behavior while completing assigned material; the teacher reviewed expectations with 
Jose and explained that she would give him tokens if his self-management improved. 

Comparison 

The study used a reversal-withdrawal design for both students. During the baseline/withdrawal 
condition for each student, teachers taught their classes as usual. 

Outcomes and 
measurement 

Amy’s outcome was off-task behavior and Jose’s outcome was on-task behavior; both out- 
comes fall under the school engagement domain. Amy and Jose’s teacher and three under- 
graduate students (referred to as “independent observers”) collected the observational data 
for all phases; the WWC visual analysis focused on the data collected by the independent 
observers. For a more detailed description of these outcome measures, see Appendix B. 

Christensen et al. (2012) also measured the teacher’s function-based support knowledge. 

This outcome is not presented in the report because it does not fall under a domain specified 
in the protocol. 

Results from the two experiments with outcomes in the school engagement domain are pre- 
sented in Appendix C.1 . 

Support for 
implementation 

The teacher received FBA training which involved group instruction, independent readings, 
applied activities, and individual consultation. The group instruction was the main component 
of training and consisted of four 1-hour training sessions conducted after school. The teacher, 
upon completing initial training, served as the primary interventionist with continued support. 

Maintenance 

There was no maintenance phase for Jose. Amy’s teacher systematically reduced the interven- 
tion during two maintenance phases. Amy’s off-task behavior during these phases was similar 
to her behavior during the first and second intervention phases. 

Author-reported 

findings 

The study authors found that the FBA-based interventions decreased Amy’s off-task behavior 
and increased Jose’s on-task behavior. The results of WWC’s corresponding visual analysis 
are presented in Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards With Reservations. 

Reason for study rating: The experiments for Amy and Jose used reversal-withdrawal designs 
and there were fewer than five data points in at least one phase; because all phases had at 
least three data points (rather than five), these experiments meet WWC pilot single-case design 
standards with reservations. 
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Appendix A.9: Research details for Clarke et al. (1995) 

Clarke, S., Dunlap, G., Foster-Johnson, L., Childs, K. E., Wilson, D., White, R., & Vera, A. (1995). Improv- 
ing the conduct of students with behavioral disorders by incorporating student interests into cur- 
ricular activities. Behavioral Disorders, 20, 221-237. 


Setting 

The study took place in two classrooms at a public elementary school. Ahmad was in a kinder- 
garten classroom for students with severe emotional disturbance (SED). The classroom con- 
tained eight children and was staffed by a teacher and a full-time aide; Ahmad’s study took place 
during language arts lessons. Juan and Shane were in a class for students who exhibited SED 
and included eight to nine children, a teacher, and an aide. Their grade-level was not reported. 

Study sample 

Four students were part of the study sample. Ahmad was 5 years old and Juan and Shane 
were 11. All three students had been diagnosed as having an SED. Ahmad’s teacher reported 
that his most problematic behaviors at school were aggression, noncompliance, property 
destruction, inability to maintain task engagement, and leaving his area without permission. 
Juan’s disruptive behaviors included noise making, talking out, property destruction, exces- 
sive off-task behavior, and noncompliance. At the time of the study, Juan was taking Imipra- 
mine. In addition to SED, Shane was diagnosed with Attention Deficit Hyperactivity Disorder; 
he demonstrated excessive off-task behavior, an inability to complete assignments, property 
destruction, and noncompliance. 

The single-case design experiments for an additional student, Arnold, are not eligible for this 
review because he did not have an emotional disturbance, but had instead received a diag- 
nosis of autism. As a result, Arnold’s single case design experiments are not described in this 
report or included in the ratings of effectiveness. 

Intervention 

Functional behavioral assessment (FBA) procedures for each student included interviews with 
teachers, other adults, and students, followed by direct observations. Based on the results, 
researchers developed FBA-based interventions that involved incorporating students’ interests 
in the curriculum. Ahmad’s intervention involved replacing standard alphabet letter worksheet 
pictures with pictures of cars and motorcycles. Juan’s intervention involved replacing the 
content of cursive sentences he was to copy from a handwriting workbook with content from 
Nintendo game booklets. The first phase of Shane’s intervention was identical to Juan’s, but 
later phases also involved presenting the assignments in smaller increments (one sentence at 
a time) and permitting him to copy directly onto the handwriting sheet. 

Comparison 

The study used a reversal-withdrawal design for all three students. The baseline/withdrawal 
condition consisted of identical assignments as the intervention, without the curricular modi- 
fications. The classroom staff utilized their business-as-usual behavior management system 
throughout all phases of the study, whereby appropriate behavior was reinforced with tokens 
that were exchangeable for rewards on a weekly basis. 
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Outcomes and 
measurement 

The study measured students’ desirable and disruptive behavior, which fall within the school 
engagement and problem behavior domains, respectively. For a more detailed description of 
these outcome measures, see Appendix B. 

The study also measured student productivity and social validity of the intervention via student 
and teacher intervention ratings. Student productivity is not presented in the report because 
the study authors did not provide visual analysis from the single-case designs, so these 
designs do not meet review requirements. Social validity does not fall under a domain speci- 
fied in the protocol. 

Results from the three experiments with outcomes in the school engagement domain are 
presented in Appendix C.l. Results from the three experiments with outcomes in the problem 
behavior domain are presented in Appendix C.2. 

Support for 
implementation 

Not reported. 

Maintenance 

There were no maintenance phases. The study did include weekly follow-up sessions for Juan 
and Shane, in which the intervention condition was used to assess the durability of effects. For 
both students, the follow-up data were more consistent with their intervention data than their 
baseline data. 

Author-reported 

findings 

The study authors reported that the FBA-based interventions increased desirable behavior 
and decreased disruptive behavior for Ahmad, Juan, and Shane. The results of WWC’s corre- 
sponding visual analysis are presented in Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards With Reservations. 

Reason for study rating: In each of the study’s reversal-withdrawal experiments, there were fewer 
than five data points in at least one phase; because all phases had at least three data points (rather 
than five), these experiments meet WWC pilot single-case design standards with reservations. 


Appendix A.10: Research details for Davis et al. (2012) 

Davis, D. H., Fredrick, L. D., Alberto, P. A., & Gama, R. (2012). Functional communication training with- 
out extinction using concurrent schedules of differing magnitudes of reinforcement in classrooms. 
Journal of Positive Behavior Interventions, 14(3), 162-172. doi:10.1177/1098300711429597 


Setting 

Participants were enrolled in a public school program for students diagnosed with a severe 


emotional and behavior disorder (EBD). Students received instruction in their regular class- 
rooms from their regular teacher. The intervention was administered during times the teachers 
identified as periods when the most inappropriate behaviors typically occurred. 
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Study sample 


Intervention 


Comparison 


The study sample consisted of four individual students classified with a severe EBD and an 
intellectual disability (ID). Eli was 18 and receiving services for both diagnoses. His prob- 
lem behaviors included leaving the classroom, turning over furniture, and displaying physi- 
cal aggression toward staff. Mary was 8 and was receiving services for EBD, a moderate ID, 
cerebral palsy, and a feeding disorder. Her problem behavior was forcefully hitting others. 

Todd was 17 and receiving services for EBD, a moderate ID, autism, and limited speech. His 
problem behaviors included screaming, throwing, hitting, crying, yelling, refusing to move, and 
picking at the skin on his hands. 

The study also reported outcomes for an additional student (Tony) with EBD; the response 
to an author query revealed that inter-assessor agreement data were not collected during 
his second baseline phase, so the experiment for this student does not meet WWC pilot 
single-case design standards. As a result, Tony’s experiment is not described in this report 
or included in the ratings of effectiveness. 

Functional behavioral assessment (FBA) procedures for each student included interviews with 
teachers, followed by direct observations. Based on the results, researchers developed func- 
tional communication training interventions that trained students to request a short break for a 
preferred activity, instead of acting inappropriately. Following the first baseline phase, students 
were trained to place a break card in their teacher’s hand to ask for a break. They would then 
receive the break and a reward. If the students did not place the break card in their teacher’s 
hand or displayed inappropriate behavior within 5 seconds of the start of the session, the 
teacher physically prompted the students to place the break card in their hand. The students 
then received a break and a reward. Training ended when the students successfully placed the 
break card in their teacher’s hand five consecutive times. 

After training, the teacher placed the work and the break card on the student’s desk and 
reminded the student that using the break card (referred to as an “alternative mand behavior” 
in the original study) would result in receiving a break and a reward. Students were then either 
rewarded with the activity of their choosing if they used the alternative behavior on which they 
were trained or penalized for inappropriate behavior by being removed from the task without 
getting to do a desired activity. 

Each student’s reward was based on his/her FBA. Eli’s reward was playing puzzle games or 
listening to music with his headphones; Mary’s reward was playing with plastic straws and 
eating pudding; and Todd’s reward was sensory reinforcement including hand games and ear 
tickling. When the student displayed inappropriate behavior, the student received a 30-second 
break without a reward. Eli’s second intervention phase included a 30-second delay in which 
he would receive reinforcement. 

The study used a reversal-withdrawal design for all three students. During the baseline/with- 
drawal condition, students did not have access to their break card, and negative reinforce- 
ment was used for inappropriate behavior. This involved removal from a task for a period of 
30 seconds. 
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Outcomes and 
measurement 


Support for 
implementation 


Maintenance 


Author-reported 

findings 

WWC study rating 


The study’s two outcomes were time on task, which falls under the school engagement 
domain, and inappropriate behavior, which falls under the problem behavior domain. Time on 
task was not measured for Todd. For a more detailed description of these outcome measures, 
see Appendix B. 

For Todd and Mary, there were two or fewer data points in one of the baseline phases for their 
outcome measures. These cases would typically not meet WWC pilot single-case design stan- 
dards for a reversal-withdrawal design because of the lack of data points; however, the review 
protocol allows phases to be shortened if extended baseline phases pose serious ethical and 
procedural concerns. Because baseline phases for Todd and Mary were cut short due to self- 
injurious and aggressive behavior (described in the original study or confirmed by the authors), 
Todd and Mary’s designs meet standards with reservations. 

The study also measured the number of times the students gave the break card to their 
teacher; this outcome is ineligible for review because it is considered to be a part of the inter- 
vention (and as such, was only measured and relevant during the intervention phases). The 
study also measured the social validity of the intervention, which does not fall under a domain 
specified in the protocol. 

Results from the two experiments with outcomes in the school engagement domain are 
presented in Appendix C.l. Results from the three experiments with outcomes in the problem 
behavior domain are presented in Appendix C.2. 

Teachers received training from the researchers before the FBA and implementation of the 
intervention. The training consisted of a review and practice of the procedures until they were 
performed with 100% accuracy. Researchers were also present during all study phases to 
provide support to teachers. 

During additional maintenance phases for Eli and Mary, both students experienced gradual 
reduction of the reinforcement. Specifically, there was an increasing delay of when they would 
receive a reward for displaying the alternate behavior. Mary had a delay ranging from 5 to 20 
seconds in five additional phases; two of these phases also included group instruction with a 
paraprofessional or substitute paraprofessional. Mary’s inappropriate behavior during these 
phases was consistent with her intervention data, and her time on task increased dramati- 
cally during these additional phases. Eli had a thinning phase with a delay of 60 seconds that 
occurred after the ABAB design; both outcomes from the additional phases were consistent 
with his intervention data. 

The study authors reported that the FBA-based intervention increased time on task for Eli, had 
no effect on Mary’s time on task, and decreased inappropriate behaviors for Eli, Mary, and 
Todd. The results of WWC’s corresponding visual analysis are presented in Appendix C. 

Meets WWC Pilot Single-Case Design Standards With Reservations. 

Reason for study rating: In each of the study’s reversal-withdrawal experiments, there were 
fewer than five data points in at least one phase; because all phases had at least three data 
points (rather than five), these experiments meet WWC pilot single-case design standards with 
reservations. 
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Appendix A.11: Research details for Dunlap et al. (1995) 

Dunlap, G., Foster-Johnson, L., Clarke, S., Kern, L., & Childs, K. E. (1995). Modifying activities to 
produce functional outcomes: Effects on the problem behaviors of students with disabilities. 
Journal of the Association for Persons with Severe Handicaps, 20(4), 248-258. 


Setting 

The study took place in a school in Florida. The sessions were conducted in a separate room 


by an aide who was familiar with the students. A behavior management system was in place 
in the classroom. 

Study sample 

Three students were part of the study sample. Jill was 13 years old and had multiple disabilities, 
including severe emotional disturbance, mild mental retardation, schizophrenia, and attention 
deficit disorder. 

The study reported outcomes for two additional students, Jary and Natalie. The single-case 
design experiment for Jary is not eligible for this review because he was not diagnosed with 
an emotional disturbance, but was instead diagnosed as having autism and an intellectual dis- 
ability. Natalie’s study design did not meet WWC pilot single-case design standards because 
there were fewer than three data points in at least one phase of her reversal-withdrawal design 
experiment. As a result, their single case design experiments are not described in this report or 
included in the ratings of effectiveness. 

Intervention 

Functional behavioral assessment (FBA) procedures included interviews with teachers, followed 
by direct observations. Based on the FBA, an intervention was developed that retained 
instructional objectives but modified curricular activities to better align with Jill’s interests. The 
FBA-based intervention consisted of writing captions onto a blank sheet of lined paper that 
were related to photographs that she had taken earlier in the week. The instructional objective 
was to demonstrate the correct use of letter formation and spacing in handwriting. 

Comparison 

The study used a reversal-withdrawal design. Jill’s baseline/withdrawal condition consisted of 
regular instruction and copying words from a handwriting book onto a blank sheet of lined paper. 

Outcomes and 
measurement 

The study included on-task behavior, which falls into the school engagement domain, and the 
percentage of intervals in which the student displays problem behavior, which falls in the problem 
behavior domain. For a more detailed description of these outcome measures, see Appendix B. 

The study also measured student productivity, interest, and happiness. Student productivity is 
not presented in the report because the study authors did not provide visual analysis from the 
single-case design experiments, so these experiments do not meet review requirements. Inter- 
est and happiness do not fall under a domain specified in the protocol. 

Results from the one experiment with an outcome in the school engagement domain are 
presented in Appendix C.l. Results from the one experiment with an outcome in the problem 
behavior domain are presented in Appendix C.2. 

Support for 
implementation 

Not reported. 

Maintenance 

There was no maintenance phase. 


Functional Behavioral Assessment-based Interventions December 201 6 


Page 46 


WWC Intervention Report 


Author-reported 

findings 

The study authors reported that the FBA-based intervention produced a small increase in Jill’s 
on-task behavior when first introduced and a large increase in on-task behavior when the inter- 
vention was re-introduced. They also reported a small decrease in problem behavior when the 
FBA-based intervention was first introduced to Jill, extremely high levels of problem behavior 
when the intervention was withdrawn, and a large decrease in problem behavior when the inter- 
vention was re-introduced; they characterized these results as demonstrating improvement in 

Jill’s behavior. The results of WWC’s corresponding visual analysis are presented in Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards With Reservations. 

Reason for study rating: There were fewer than five data points in at least one phase for both 
of Jill’s outcomes; because all phases had at least three data points (rather than five), these 
experiments meet WWC pilot single-case design standards with reservations. 


Appendix A.12: Research details for Dunlap et al. (1996) 

Dunlap, G., White, R., Vera, A., Wilson, D., & Panacek, L. (1996). The effects of multi-component, 

assessment-based curricular modifications on the classroom behavior of children with emotional 
and behavioral disorders. Journal of Behavioral Education, 6(4), 481-500. 


Setting 

The study took place in classrooms serving students with an emotional and behavioral disor- 
der (EBD) at a public elementary school in a large southeastern US city. Ann and Michael were 
in the same classroom, which was served by one teacher and one aide. Gizelle was in a differ- 
ent classroom that was also served by one teacher and one aide. The study was conducted 
during English classes for Michael and Gizelle and during handwriting sessions for Ann. 

Study sample 

Three students were part of the study sample. All three students had been labeled “severely 
emotionally disturbed” by officials in their school. Each student exhibited problem behaviors 
and lack of task engagement prior to the study. Michael and Ann were 7 years old, and Gizelle 
was 9 years old. Michael and Ann were in the same classroom, although Michael was consid- 
ered second-grade status, while Ann was first-grade status. Gizelle was in the fourth grade. 

Intervention 

Functional behavioral assessment (FBA) procedures included a review of records; interviews 
with teachers, students, and parents; and classroom observations. Based on the FBA, a multi- 
component, curricular intervention was designed for each student. 

The FBA-based intervention packages for all three students included elements of choice— 
Michael and Gizelle were allowed to choose from a menu of worksheets, and Ann was allowed 

to choose what words she would trace on a worksheet. Michael’s intervention also included 
dividing each longer assignment into two shorter assignments, and the font size of all printed 
materials was increased. For Gizelle, worksheets were modified by highlighting certain words 
to draw attention to them, adding pictures to clarify instructions, and adjusting worksheets to a 
lower reading level that was more consistent with her ability level; longer assignments were also 
divided into two shorter assignments. Ann’s intervention gave her the opportunity to select food 
items from a mock grocery store, after tracing food names on four different worksheets. 

Comparison 

The study used a reversal-withdrawal design for all three students. The baseline/withdrawal 
condition consisted of normal classroom activities without modifications. 
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Outcomes and 
measurement 

The study measured task engagement, which falls under the school engagement domain, and 
disruptive behavior, which falls under the problem behavior domain, for all three students. For 
a more detailed description of these outcome measures, see Appendix B. 

The study also measured students’ performance-on-task and teacher attention; students’ 
performance-on-task is not presented in this report because the study authors did not provide 
visual analysis from the single-case design experiments, so these experiments do not meet 
review requirements. Teacher attention does not fall under a domain specified in the protocol. 

Results from the three experiments with outcomes in the school engagement domain are 
presented in Appendix C.l. Results from the three experiments with outcomes in the problem 
behavior domain are presented in Appendix C.2. 

Support for 
implementation 

Not reported. 

Maintenance 

There was no maintenance phase. 

Author-reported 

findings 

The study authors found that the FBA-based intervention increased the level of task engage- 
ment and decreased problem behavior for Michael, Gizelle, and Ann. The results of WWC’s 
corresponding visual analysis are presented in Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards With Reservations. 

Reason for study rating: In all three reversal-withdrawal experiments, and across both out- 
comes, there were fewer than five data points in at least one phase; because all phases had 
at least three data points (rather than five), these experiments meet WWC pilot single-case 
design standards with reservations. 


Appendix A.13: Research details for Janney et al. (2013) 

Janney, D. M., Umbreit, J., Ferro, J. B„, Liaupsin, C. J., & Lane, K. L. (2013). The effect of the extinction 
procedure in function-based intervention. Journal of Positive Behavior Interventions, 15(2), 

1 1 3-1 23. doi:1 0.1 1 77/1 098300712441 973 


Setting 

The study took place in general education classrooms in one elementary school in the south- 
western United States. 

Study sample 

The study sample included three male students, Hugo, Tomas, and Eric, all of whom were at 
risk for an emotional and behavioral disorder and below average in academic competence. 
Their teachers had sought help from the school’s student behavior intervention team because 
of the students’ behavior and academic problems. Hugo was 6 years old and in the first grade. 
Tomas was 7 years old and in the second grade. Eric was 8 years old and in the third grade. 

Intervention 

Functional behavioral assessment (FBA) procedures included reviews of student records, 
interviews with teachers and students, and direct observations. Results of the FBA suggested 
that Hugo displayed off-task behavior to obtain attention from his teacher. Tomas displayed 
off-task behavior when having difficulty with academic tasks; teacher and peer attention rein- 
forced his off-task behavior. Eric engaged in off-task behavior during writing activities, espe- 
cially when he was having difficulty; his off-task behavior was reinforced when he did not have 
to finish the task and when he received teacher attention. 
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Each student had slightly different intervention features. Hugo’s FBA-based intervention 
included sitting close to the teacher, providing teacher attention if he was on task for 1 min- 
ute or longer, and redirecting off-task behavior once and then ignoring subsequent problem 
behaviors (referred to as extinction). Tomas’s FBA-based intervention included using clear 
verbal instructions for transition behavior, providing teacher attention if he was on task for 1 
minute or longer, and redirecting problem behavior once and then ignoring subsequent prob- 
lem behaviors. For Eric, the FBA-based intervention involved sitting close to the teacher, offer- 
ing small group instruction and shortened assignments, providing teacher attention if he was 
on task for 1 minute or longer, and redirecting behavior once and then ignoring subsequent 
off-task behaviors, as well as maintaining the given task until it was completed. 

The WWC visual analyses for each student focuses only on the initial ABAB phases of the 
reversal-withdrawal design, which compared the baseline condition to the full FBA-based 
intervention, including the extinction procedure. However, the study also compared the FBA- 
based intervention to a partial intervention phase, without extinction. This comparison is not of 
interest for this review because it does not compare the effect of an FBA-based intervention to 
a non -FBA-based intervention. 

Comparison 

The study used a reversal-withdrawal design for all three students. The baseline/withdrawal 
condition consisted of normal practices in each classroom. 

Outcomes and 
measurement 

The outcome for all three students was on-task behavior, which falls in the school engagement 
domain. For a more detailed description of this outcome measure, see Appendix B. 

Results from the three experiments with outcomes in the school engagement domain are pre- 
sented in Appendix C.1 . 

Support for 
implementation 

The research team gave teachers daily feedback on their implementation of the intervention. 
The primary observer also gave the teacher a signal to indicate that it was time for the teacher 
to give reinforcement for on-task behavior. 

Maintenance 

There was no maintenance phase. The study used an ABABCB design for all three students, 
with a follow-up phase after the last intervention phase, in which the teachers continued to 
use the full intervention. Improvements in on-task behavior were generally maintained during 
the follow-up phase for all three students. 

Author-reported 

findings 

The study authors found that the FBA-based interventions increased on-task behavior for 
Hugo, Tomas, and Eric. The results of WWC’s corresponding visual analysis are presented in 
Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards With Reservations. 

Reason for study rating: In all three reversal-withdrawal experiments, there were fewer than 
five data points in at least one phase; because all phases had at least three data points (rather 
than five), these experiments meet WWC pilot single-case design standards with reservations. 
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Appendix A.14: Research details for Kern et al. (2001) 

Kern, L., Delaney, B., Clarke, S., Dunlap, G., & Childs, K. (2001). Improving the classroom behavior of 
students with emotional and behavioral disorders using individualized curricular modifications. 
Journal of Emotional and Behavioral Disorders, 9(4), 239-247. 


Setting 

The study took place at two public elementary schools in self-contained classrooms for stu- 
dents with emotional and behavioral disorders. Both classrooms had 8-10 students, a teacher, 
and a paraprofessional. The study sessions took place during a journal activity for Art and 
handwriting activities for Benjamin. All classroom management procedures, including a point 
system providing awards for different behaviors, remained constant across all phases of the 
study. 

Study sample 

Two students were part of the study sample. Both students were 1 1 years old and in the fifth 
grade. Art was diagnosed as having an emotional disturbance. He had poor task engage- 
ment and peer relations and demonstrated disruptive behavior and frequent noncompliance. 
Benjamin was diagnosed as having an emotional and behavioral disorder and Attention Deficit 
Hyperactivity Disorder. He displayed frequent disruptive behaviors and poor task engagement 
and peer relations. 

Intervention 

Functional behavioral assessment (FBA) procedures for both students included direct obser- 
vations of students and structured interviews with teachers, other school staff, and students. 
Based on the FBA, researchers hypothesized that problem behavior would decrease and task 
engagement would increase for both students if they could complete their work in a preferred 
writing medium. It was also hypothesized that Benjamin’s behavior would improve if his inter- 
ests were incorporated into his tasks. 

Art’s FBA-based intervention involved using a preferred writing medium, a portable laptop 
computer, during journal assignments in which he could write about either a topic provided by 
the teacher or one of his own choosing. Benjamin’s FBA-based intervention required him to 
neatly copy four to five sentences from a photocopied handwriting sheet onto a blank sheet of 
paper. In the intervention condition, the handwriting sheets consisted of copies of pages from 
a Sega Genesis game booklet. 

For Benjamin, the study authors also examined another FBA-based intervention that involved 
giving him the choice of one of three media with which to complete his spelling assignments; 
the experiment used an ABACDC design for this comparison and does not meet WWC pilot 
single-case design standards because it did not include at least three attempts to demon- 
strate an intervention effect at three different points in time. 

Comparison 

The study used a reversal-withdrawal design for both students. During the baseline/withdrawal 
condition, Art used traditional paper and pencil during journal assignments rather than a laptop. 
Art’s journal assignment required that he write about either a topic provided by the teacher or 
one of his own choosing. He was required to complete this assignment in a composition note- 
book. Benjamin was assigned sentences from a handout including topics such as dinosaurs, 
funny poems, or the solar system for his writing assignments. His daily assignment was to 
neatly copy four to five sentences from a photocopied handwriting sheet onto a blank sheet of 
paper. In all other ways, the assignments were identical to those in the intervention condition. 
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Outcomes and 
measurement 

The study’s eligible outcomes are task engagement, which falls under the school engagement 
domain, and disruptive behavior, which falls under the problem behavior domain. For a more 
detailed description of these outcome measures, see Appendix B. 

For Art, the study also examined a work productivity outcome— measured as the number of words 
written per minute— but this outcome does not fall under a domain specified in the protocol. 

Results from the two experiments with outcomes in the school engagement domain are pre- 
sented in Appendix C.l. Results from the two experiments with outcomes in the problem behavior 
domain are presented in Appendix C.2. 

Support for 
implementation 

Not reported. 

Maintenance 

There was no maintenance phase. 

Author-reported 

findings 

The study authors reported that the FBA-based interventions increased task engagement and 
decreased disruptive behavior for Art and Benjamin. The results of WWC’s corresponding 
visual analysis are presented in Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards With Reservations. 

Reason for study rating: For both students’ reversal-withdrawal experiments, there were fewer than 
five data points in at least one phase; because all phases had at least three data points (rather than 
five), these experiments meet WWC pilot single-case design standards with reservations. 


Appendix A.15: Research details for Mustian (2011) 

Mustian, A. L. (2011). The comparative effects of function-based versus nonfunction-based interven- 
tions on the social behavior of African American students. Available from ProQuest Dissertations 
and Theses database. (UMI No. 3422674) 


Setting 

The study took place in two fifth-grade general education classrooms in an urban public 

Study sample 

elementary school in a metropolitan district in the southeastern United States. Teachers in 
both classrooms used a token economy system to encourage class participation and overall 
appropriate classroom behavior. The school population was 64% African American and 18% 
White, with Hispanic and other races making up the remainder. Approximately 86% of the 
students received free or reduced-priced lunch. 

Four students were part of the study sample. The study included two 1 1 -year-old African- 
American male students (Todd and Alan) who were at risk for an emotional and behavioral 
disorder. Two additional students were dropped partway through their functional behavioral 
assessments (FBAs) due to minimal instances of problem behaviors. The author reported 
that both students had begun taking medication during the course of the FBA, which likely 
explains the diminishment of their problem behaviors. These students are not included in the 
WWC review of this study or included in the ratings of effectiveness, as graphical analysis of 
their outcome data was not presented. 


Functional Behavioral Assessment-based Interventions December 201 6 


Page 51 


WWC Intervention Report 


Intervention 


Comparison 

Outcomes and 
measurement 


Support for 
implementation 

Maintenance 

Author-reported 

findings 

WWC study rating 


FBA procedures for both students included direct observations and interviews with teachers. 
The FBA process resulted in largely identical FBA-based interventions for both participants. A 
laminated schedule card was provided to each student during the intervention periods (a small 
group or whole class reading period). The student was trained to use the card as a reference, 
as well as a timed reminder system to record his behavior, leading to self-initiated breaks from 
the reading activity. Alan’s desk was also relocated so he was in close proximity to his teacher 
and farther away from peers. Todd received ten sessions of the intervention, which were 40 
minutes in length. Alan received seven total sessions of the intervention, which were 30 min- 
utes in length. 

The study used a reversal-withdrawal design for both students. The baseline/withdrawal con- 
dition consisted of normal classroom practice, including encouragement and basic reminders 
to the whole class about on-task behavior. Students were prevented from taking breaks, as 
opposed to the break system used in the intervention. 

The primary outcome measure was off-task problem behavior, which falls in the problem 
behavior domain. For a more detailed description of this outcome measure, see Appendix B. 
Mustian (2001) also measured self-management behavior; this outcome was measured during 
intervention phases only and thus does not meet WWC review requirements. 

Results from the two experiments with outcomes in the problem behavior domain are pre- 
sented in Appendix C.2. 

Teachers received approximately 12 hours of training on FBA procedures. The training was 
divided into four modules. After completion of each module, teachers were required to com- 
plete that portion of the FBA with the students in the study. Once completed, the teachers 
worked with study personnel to craft a behavioral intervention plan for the students. 

There was no maintenance phase. 

The study author found that the FBA-based interventions decreased off-task problem behavior for 
Todd and Alan. The results of WWC’s corresponding visual analysis are presented in Appendix C. 

Meets WWC Pilot Single-Case Design Standards With Reservations. 

Reason for study rating: For both students’ reversal-withdrawal experiments, there were fewer than 
five data points in at least one phase; because all phases had at least three data points (rather than 
five), these experiments meet WWC pilot single-case design standards with reservations. 
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Appendix A.16: Research details for Nahgahgwon et al. (2010) 

Nahgahgwon, K. N., Umbreit, J., Liaupsin, C. J., & Turton, A. M. (2010). Function-based planning for 
young children at risk for emotional and behavioral disorders. Education and Treatment of Chil- 
dren, 33(4), 537-559. 

Setting This study was conducted at an elementary school that served approximately 800 students in 
grades K-6 and included a total of 35 classrooms. A schoolwide discipline model was used to 
address the behavioral needs of students. Additional support, including a daily management 
system and replacement behavior training, was provided to students who continued to exhibit 
behavioral problems. The three students in this study were not responsive to these interven- 
tions, so they were identified to receive a functional behavioral assessment (FBA) and an 
individualized behavior intervention plan. 

The study took place in each student’s general education classroom. Josh’s class had 30 students, 
and his teacher had 5 years of teaching experience. Zane’s class had 25 students, and his teacher 
had 4 years of teaching experience. Ian’s class had 30 students, and his teacher had 1 year of 
teaching experience. Observation sessions (for all conditions) occurred during the classroom 
activities that the students’ teachers had indicated were most likely to elicit problem behavior. 

Study sample Three students were part of the study sample. All participants were considered at risk for an 

emotional and behavioral disorder due to ongoing behavioral problems that negatively affected 
their academic and social development. Josh was a 6-year-old Hispanic boy in first grade who 
had behavioral issues related to adaptability, hyperactivity, social skills, attention, and conduct 
problems. Zane was a 5-year-old Caucasian boy in full-day kindergarten who had issues in the 
areas of attention, adaptability, social skills, and hyperactivity. Ian was a 6-year-old Caucasian 
boy in full-day kindergarten who had behavioral issues in the areas of hyperactivity, attention, 
adaptability, social skills, and conduct problems. By the end of the study, Ian was given a 
diagnosis of emotional disability and speech/language impairment. 

Intervention FBA procedures for each student included a review of school records, teacher and stu- 
dent interviews, and direct observation in the classroom. The results of the FBA suggested 
that Josh engaged in disruptive behavior to avoid activities that were difficult for him. Zane 
engaged in disruptive behavior to obtain attention from his teacher, especially when there was 
a long duration between opportunities to respond. Ian engaged in disruptive behavior to avoid 
difficult tasks and gain teacher attention and assistance. 

As a result of the FBA, Josh was given smaller work units and a timer to prompt feedback 
on his work. He was also offered free time after completing some work and all appropriate 
requests for help were acknowledged by his teacher. When he demonstrated off-task behav- 
ior, he was redirected to the task. To increase Zane’s likelihood of being on task, the teacher 
provided a reminder of expected behavior to the whole class before instruction and as needed 
during instruction. His off-task behavior was ignored, but he was called on the first time he 
responded appropriately and was called on again up to three additional times as a means of 
reinforcing on-task behavior. Ian’s work was modified for his fluency level, and he received 
brief instructions at the start of each lesson. The teacher explained behavioral expectations 
to the whole class and repeated these individually to Ian. Reinforcement of on-task behavior 
included providing free time following task completion and providing periodic attention. Off- 
task behavior was addressed via redirection and maintaining the task demand. 
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Comparison 

The study used one multiple baseline design experiment across three students. Baseline con- 
ditions were not explicitly described, other than mention of the schoolwide positive behavior 
supports. 

Outcomes and 
measurement 

The primary outcome measure was on-task behavior, which falls in the school engagement 
domain. For a more detailed description of this outcome measure, see Appendix B. 

The study also measured students’ office referrals and teacher reports of social validity of the 
intervention. The study authors did not provide visual analysis from single-case designs for 
these outcomes; thus, these designs do not meet review requirements, and these outcomes 
are not presented in the report. In addition, social validity does not fall under a domain speci- 
fied in the protocol. 

Results from the one experiment with an outcome in the school engagement domain are pre- 
sented in Appendix C.l. 

Support for 
implementation 

This was not described, though intervention integrity data confirmed that all interventions were 
implemented with high levels of fidelity. 

Maintenance 

There was no maintenance phase. 

Author-reported 

findings 

The study authors found that the FBA-based interventions increased the level of on-task 
behavior for Josh, Zane, and Ian. The results of WWC’s corresponding visual analysis are pre- 
sented in Appendix C. 

WWC study rating 

Meets WWC Pilot Single-Case Design Standards With Reservations. 

Reason for study rating: In the experiment that used a multiple baseline design across partici- 
pants, there were fewer than five data points in at least one phase; because all phases had at 
least three data points (rather than five), this experiment meets WWC pilot single-case design 
standards with reservations. 
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Appendix B: Outcome measures for each domain 


School engagement 


School engagement 


Academic engagement 

The percentage of 10-second intervals in which the student displayed academic engagement, which included 
attending to assigned materials and sitting or standing in the specified area. Academic engagement was measured 
by watching video recordings of 10-minute observation periods during class (as cited in Losinski et at, 2015). 

Appropriate task engagement 

The percentage of 10-second intervals in which the student displayed appropriate task engagement for the 
entire interval, with no problem behaviors observed. Appropriate task engagement for Freddy included looking 
at the teacher or class materials, raising a hand for permission to speak, limiting comments to the relevant 
topic, and attempting to respond. For Clay, appropriate task engagement included providing written responses 
to math problems (irrespective of accuracy) and looking at the teacher while directions were given (as cited in 
Hagan-Burke et al., 2015). a 

Compliance with teacher 

The percentage of 1 5-second intervals in which the student displayed compliant behavior for the entire interval. 
Compliant behavior was aligned with the assigned activity listed on the board, including pulling out binder, look- 
ing up at the board, copying the question on the board, looking at notes or textbook for the answer, and raising 
hand to request teacher’s attention. Each session typically lasted 5-10 minutes, from the time that class began 
to the time the teacher indicated that it was time to transition to a new activity (as cited in Lane et al., 2007a). 

Desirable behavior 

The percentage of 10-second intervals with observed desirable behavior. Data were collected in 15-second 
intervals, where 10 seconds were used for observations and 5 seconds were used for recording the information. 
Examples of desirable behavior were following teacher instructions; looking at the appropriate place, such as 
at materials or the teacher; or appropriate vocalizations. Nonoccurrence of desirable behavior was scored if the 
student failed to be engaged for a period exceeding 3 consecutive seconds. Sessions for Arnold and Ahmad 
lasted as long as it took for the student to complete the assigned task, with a limit of 15 minutes. Sessions for 
Juan and Shane, who were studied simultaneously, lasted for 7 minutes, with observations alternating every 
minute between the two students (as cited in Clarke et al., 1995). 

Off-task behavior 

Off-task behavior was measured in two studies, but the measurement and definition of the outcome varied: 

The percentage of 1 -minute intervals, per session, in which the student displayed off-task behavior, such as 
walking around, reading when not assigned to do so, and not paying attention. All observation sessions lasted 
approximately 1 5 minutes (as cited in Christensen et al., 2012). a 

The rate of off-task behavior during a 60-minute observation session. The teacher collected data daily using 
event recording, and occurrences were converted to a rate. Off-task behavior included speaking to peers, 
teachers, or others without permission, and being out of the assigned area or involved in tasks other than those 
assigned by the teacher (as cited in Lane et al., 2007b). 

On-task behavior 

On-task behavior was measured in multiple studies, but the measurement and definition of the outcome varied: 
The percentage of 1 -minute intervals, per session, in which the student displayed on-task behavior, such as 
working on assigned material. All observation sessions lasted approximately 15 minutes (as cited in Christensen 
et al., 2012), a 

The percentage of 10-second intervals with observed on-task behavior. Data were collected in 15-second 
intervals, where 10 seconds were used for observations and 5 seconds were used for recording the information. 
Examples of on-task behavior were following teacher instructions and looking at the appropriate place, such as 
at materials or the teacher (as cited in Dunlap et al., 1995 and Kern et al., 1994), 

The percentage of total session time that the student was observed to be on task. Examples of on-task behavior 
included attending to assigned materials, raising hand to request teacher's attention, remaining in seat, and 
waiting for teacher instruction. The duration of on-task behavior was entered only after the behavior had 
occurred for at least 3 seconds (as cited in Hansen et al., 2014). a 

The percentage of 15-second intervals in which on-task behavior was observed and off-task behavior was not 
observed. Examples of on-task behavior included remaining in seat, looking at the teacher or class materials, and 
following teacher instructions. Off-task behavior included leaving seat during instruction, having conversations 
with the teacher that were not relevant to classwork, calling out responses without being called on, putting away 
supplies needed for the task, slumping in chair, using objects to make noise, and refusing to finish an assignment. 
Sessions lasted 10 minutes for Hugo and Tomas and 15 minutes for Eric (as cited in Janney et al., 2013) a 

The percentage of 30-second intervals in which on-task behavior was observed. Examples of on-task 
behavior included remaining in assigned seat or area and raising hand before asking for help (as cited in 
Nahgahgwon et al., 2010). 
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Socially-appropriate classroom behavior The percentage of 10-second intervals in which the student displayed socially-appropriate behavior for the entire 

interval. Socially-appropriate classroom behavior included paying attention, completing work, reading aloud, 
answering questions, appropriately obtaining teacher attention, and complying with instructions. The length of 
observation sessions ranged from 23 to 36 minutes (as cited in Christensen et at, 2004). 

Task engagement Task engagement was measured in two studies, but the measurement and definition of the outcome varied: 

The percentage of 10-second intervals with observed task engagement. Data were collected in 15-second 
intervals, where 10 seconds were used for observations and 5 seconds were used for recording the information. 
Students were considered engaged if they were looking at assigned materials during independent work or were 
looking at the teacher during verbal instruction (as cited in Dunlap et at, 1996). 

The percentage of 10-second intervals (for Art) or 15-second intervals (for Benjamin) during which the student 
was engaged for 70% of the time, where engaged was defined as working on an assigned activity in accordance 
with the teacher's instructions. This included attending to materials during written or manipulative assignments 
or having eyes on the teacher during lecture or verbal instruction (as cited in Kern et al., 2001), a 

Time on task The percentage of time the student was on task and engaged in seatwork, during a 10-15 minute session (as 

cited in Davis et al., 2012). a 


Problem behavior 


Disruptive behavior Disruptive behavior was measured in multiple studies, but the measurement and definition of the outcomes varied: 

The percentage of 10-second intervals with observed disruptive behavior. Data were collected in 15-second 
intervals, where 10 seconds were used for observations and 5 seconds were used for recording the information. 
Disruptive behavior was defined as any behavior that interfered with classroom activities, including aggression, 
talking without staff permission, vocal or nonvocal noise-making, leaving seat without permission, property 
destruction, and noncompliant behavior, which was defined as failing to follow instructions within 5 seconds (as 
cited in Clarke et at, 1995). 

The percentage of 10-second intervals with observed disruptive behavior. Data were collected in 15-second 
intervals, where 10 seconds were used for observations and 5 seconds were used for recording the informa- 
tion. Disruptive behavior was defined individually for each student, based on their prior behavior issues. For 
Michael, disruptive behavior included property destruction, speaking negatively to an adult, speaking without the 
teacher’s permission, and not staying in his seat. For Gizelle, disruptive behaviors included property destruction, 
speaking negatively to an adult, and speaking without the teacher’s permission. Ann's disruptive behaviors 
included aggression, not staying in her seat, not following instructions (after 5 seconds), speaking negatively to 
an adult, and property destruction (as cited in Dunlap et al., 1996). 

The frequency of disruptive behavior occurrences per minute. Examples of disruptive behavior included talking at 
inappropriate times and making noises with mouth, materials, or motor movements. At least 3 seconds without 
the disruptive behavior had to occur for two behaviors to be considered separate (as cited in Hansen et al., 2014). a 
The frequency of disruptive behaviors per minute (for Benjamin) and the percentage of 10-second intervals with 
observed disruptive behavior (for Art). Disruptive behavior was defined as any occurrence of nonvocal noise, 
talking out when not related to the assigned task, vocalizing profanity or negative content, leaving the work area 
without permission, or exhibiting noncompliant behavior (as cited in Kern et al., 2001). a 
The percentage of 10-second intervals in which the student displayed disruptive behavior, which included 
making inappropriate noises, pushing or touching others, and taking other students' belongings. Disruptive 
behavior was measured by watching video recordings of 10-minute observation periods during class (as cited 
in Losinski et al., 2015). 

Inappropriate behavior The frequency of inappropriate behaviors during a 10-15 minute session. Inappropriate behavior was defined 

individually for each student. Todd’s inappropriate behavior was defined as screaming, throwing, hitting, crying, 
yelling, refusing to move, and picking at the skin on his hands. Mary’s inappropriate behavior was defined as 
forcefully hitting others. Eli’s inappropriate behavior was defined as leaving the classroom, turning over furniture, 
and physical aggression toward staff (as cited in Davis et al., 2012). a 
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Off-task problem behavior 

The percentage of off-task problem behaviors observed during 1 -minute intervals. Percentages were calculated 
by dividing the number of intervals with occurrences of off-task behavior by the total number of intervals, multi- 
plied by 100. Off-task behavior was defined individually for each student. Todd’s off-task problem behavior was 
defined as playing with objects within reach, humming or singing aloud, talking to self or others about non-task 
related topics, and not looking at the teacher or instructional materials for 3 seconds or more. Alan’s off-task 
problem behavior was defined as playing with hair or objects within reach, constant body movement, talking to 
self or others about non-task related topics, being out of seat, and not looking at the teacher or instructional 
materials for 3 seconds or more (as cited in Mustian, 2011). a 

Problem behavior 

The percentage of 10-second intervals with observed problem behavior. Data were collected in 15-second 
intervals, where 10 seconds were used for observations and 5 seconds were used for recording the information. 
Problem behaviors included aggressive behavior, inappropriate talk-outs and touching, noncompliance, and 
leaving classroom or running around (as cited in Dunlap et al., 1995). 


a The authors collected inter-assessor agreement (IAA) data in each phase and on at least 20% of all sessions, but it is not clear if I AA data were collected during 20% of the data 
points in each condition. 
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Appendix C: Single-case design findings included in the effectiveness ratings 
Table C.1: Single-case design findings for the school engagement domain 


Outcome measure 

Study characteristics 

WWC summary 


Sample 
size (case) 

Age(s) 

Design type 


Intervention effects 

Evidence level 

Total 

demonstrated 

Total 

attempted 

Christensen et al. (201 2) a 

Off -task behavior (reduction) 

1 (Amy) 

Grade 4 

Reversal-withdrawal 

No evidence 

1 

3 

On-task behavior 

1 (Jose) 

Grade 4 

Reversal-withdrawal 

Strong (+) 

3 

3 

Christensen et al. (2004) b 

Time on task 

1 (Eduardo) 

8 

Reversal-withdrawal 

Strong (+) 

3 

3 

Clarke et al. (1995) 

Desirable behavior 

1 (Ahmad) 

5 

Reversal-withdrawal 

Strong (+) 

3 

3 

Desirable behavior 

1 (Juan) 

11 

Reversal-withdrawal 

No evidence 

2 

5 

Desirable behavior 

1 (Shane) 

11 

Reversal-withdrawal 

Moderate (+) 

4 

5 

Davis etal. (2012)° 

Time on task 

1 (Eli) 

18 

Reversal-withdrawal 

No evidence 

1 

3 

Time on task 

1 (Mary) 

8 

Reversal-withdrawal 

No evidence 

0 

3 

Dunlap etal. (1995) d 

On-task behavior 

1 (Jill) 

13 

Reversal-withdrawal 

No evidence 

2 

3 

Dunlap et al. (1996) 

Task engagement 

1 (Michael) 

7 

Reversal-withdrawal 

Strong (+) 

3 

3 

Task engagement 

1 (Gizelle) 

9 

Reversal-withdrawal 

Strong (+) 

3 

3 

Task engagement 

1 (Ann) 

7 

Reversal-withdrawal 

Strong (+) 

3 

3 

Hagan-Burke et al. (2015) e 

Appropriate task engagement 

1 (Freddy) 

7 

Alternating treatment 

Strong (+) 

13 

13 

Appropriate task engagement 

1 (Clay) 

9 

Alternating treatment 

Strong (+) 

5 

5 

Hansen et al. (2014)' 

On-task behavior 

1 (Isaac) 

12 

Reversal-withdrawal 

Strong (+) 

3 

3 

On-task behavior 

1 (Jeremiah) 

7 

Reversal-withdrawal 

Strong (+) 

3 

3 

On-task behavior 

1 (Ben) 

9 

Reversal-withdrawal 

Strong (+) 

3 

3 

Janney etal. (2O13) 0 

On-task behavior 

1 (Hugo) 

6 

Reversal-withdrawal 

Strong (+) 

3 

3 

On-task behavior 

1 (Tomas) 

7 

Reversal-withdrawal 

Strong (+) 

3 

3 

On-task behavior 

1 (Eric) 

8 

Reversal-withdrawal 

Strong (+) 

3 

3 

Kern et al. (1994) 

Disruptive behavior (reduction) 

1 (Eddie) 

11 

Multiple baseline 

Strong (+) 

3 

3 
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Study characteristics 


WWC summary 







Intervention effects 

Outcome measure 

Sample 
size (case) 

Age(s) 

Design type 

Evidence level 

Total 

demonstrated 

Total 

attempted 

Kern et al. (2001) 

Task engagement 

1 (Art) 

11 

Reversal-withdrawal 

Strong (+) 

3 

3 

Task engagement 

1 (Benjamin) 

11 

Reversal-withdrawal 

No evidence 

2 

3 

Lane et al. (2007a) h 

Compliance with teacher 

1 (Aaron) 

14 

Reversal-withdrawal 

Strong (+) 

3 

3 

Lane et al. (2007b) 1 

Off-task behavior (reduction) 

1 (Charlie) 

7 

Reversal-withdrawal 

Strong (+) 

3 

3 

Losinski etal. (2015)' 

Academic engagement 

1 (Alexandra, 
Peer 

separation) 

13 

Alternating treatment 

Strong (+) 

8 

8 

Academic engagement 

1 (Brenda, 
Peer 

separation) 

13 

Alternating treatment 

Strong (+) 

8 

8 

Academic engagement 

1 (Hannah, 
Peer 

separation) 

13 

Alternating treatment 

Moderate (+) 

6 

8 

Academic engagement 

1 (Larry, Peer 
separation) 

14 

Alternating treatment 

Moderate (+) 

7 

8 

Academic engagement 

1 (Alexandra, 
Teacher 
proximity) 

13 

Alternating treatment 

Strong (+) 

5 

5 

Academic engagement 

1 (Brenda, 
Teacher 
proximity) 

13 

Alternating treatment 

No evidence 

2 

5 

Academic engagement 

1 (Hannah, 
Teacher 
proximity) 

13 

Alternating treatment 

No evidence 

3 

5 

Academic engagement 

1 (Larry, 
Teacher 
proximity) 

14 

Alternating treatment 

No evidence 

2 

5 

Nahgahgwon et al. (2010) 

On-task behavior 

3 (Josh, 
Zane, and 

Ian) 

5-6 

Multiple baseline 

Strong (+) 

3 

3 


Table Notes: The WWC does not calculate effect sizes for single-case design research. Characterizations of Strong and Moderate evidence, based on WWC visual analysis, indicate 
that the experiment demonstrated an effect of the intervention. Characterizations of No evidence indicate that the experiment did not provide at least three demonstrations of an 
intervention effect in the same direction. + = a positive (favorable) effect in the desired direction. 
a For Christensen et al. (201 2), the students' ages were not reported. 

b For Christensen et al. (2004), a response to an author query confirmed that both figures in the original study were mislabeled. Figure 3 (ABAC) showed Justin's data and Figure 4 
(ABAB) showed Eduardo’s data. The study design for Justin does not meet WWC pilot single-case design standards, so his design is not described in this report or included in the 
ratings of effectiveness. 
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c For Davis et al. (201 2), the training phase is considered to be a part of the first functional communication training (FCT) intervention phase for the purposes of WWC visual analyses, 
as it was part of the functional behavioral assessment (FBA)-based intervention. After combining the training phase and first FCT phase into one phase, the visual analysis for each 
student/outcome focuses on the first four phases (ABAB). Mary had five additional phases following the ABAB design that are not included in the visual analysis. Eli also had an 
additional phase (after the ABAB design) with a 60-second delay that is not included in the visual analysis. These phase changes are not of interest for this review because they do not 
compare the effect of an FBA-based intervention to a non-FBA-based intervention, but rather compare two FBA-based interventions. 

d For Dunlap et al. (1 995), WWC visual analysis focused only on the first four phases (ABAB) that met WWC standards with reservations; in the second intervention phase, visual analy- 
ses focused on the first four data points before the baseline probe point. 

e For Hagan-Burke et al. (201 5) there were only four data points per condition for Clay, as opposed to five, so his design meets WWC pilot single-case design standards with reservations. 

f Flansen et al. (201 4) used an ABCBCDC design for three students across two outcomes. The WWC visual analyses focused only on the BCBC phases of the reversal-withdrawal design 
(self-monitoring vs. FBA-based intervention plus self-monitoring [FBSM]). Flowever, the study did provide data on additional phases: an initial baseline period, a phase of function- 
based consequences (FBC), and an additional FBSM phase. The design for the comparison between FBSM and FBC is not of interest for purposes of the WWC visual analyses because 
it does not compare the effect of an FBA-based intervention to a non -FBA-based intervention, but rather compares two FBA-based interventions. This comparison also does not meet 
WWC pilot single-case design standards because it has just two attempts to demonstrate an effect. For Ben, there were fewer than five data points in one phase, so his design meets 
WWC pilot single-case design standards with reservations. 

8 Janney et al. (201 3) used an ABABCB design for all three students. The WWC’s visual analysis focused on the ABAB portion of the design; the CB phase change is not of interest for 
this review because it does not compare the effect of an FBA-based intervention to a non- FBA-based intervention. 

h In Lane et al. (2007a), there were fewer than five data points in one phase, so this design meets WWC pilot single-case design standards with reservations. 

1 For Lane et al. (2007b), phases B1 and B2 were combined to form the first intervention phase, for the purposes of WWC visual analyses, as the FBA-based intervention was used in 
both of these phases. 

1 For Losinski et al. (2015), Hannah’s experiment for the comparison between the Teacher proximity and comparison conditions was characterized as providing Wo evidence following 
WWC visual analysis. The WWC Procedures and Standards Handbook (version 3.0) characterizes experiments as providing Moderate evidence when the experiment has at least three 
demonstrations of an effect and at least one demonstration of a non-effect. However, in the case of alternating treatment designs, the data must also demonstrate no clear effects in 
the opposite direction and an overall mean level difference for each condition in order to be characterized as providing Moderate evidence. Hannah’s experiment showed at least one 
effect in the opposite direction, so it was characterized as providing No evidence. 


Table C.2: Single-case design findings for the problem behavior domain 


Outcome measure 

Study characteristics 

WWC summary 


Sample 
size (case) 

Age(s) 

Design type 


Intervention effects 

Evidence level 

Total 

demonstrated 

Total 

attempted 

Clarke etal. (1995) 

Disruptive behavior (reduction) 

1 (Ahmad) 

5 

Reversal-withdrawal 

Strong (+) 

3 

3 

Disruptive behavior (reduction) 

1 (Juan) 

11 

Reversal-withdrawal 

No evidence 

0 

5 

Disruptive behavior (reduction) 

1 (Shane) 

11 

Reversal-withdrawal 

No evidence 

1 

5 

Davis et al. (2012) a 

Inappropriate behavior (reduction) 

1 (Eli) 

18 

Reversal-withdrawal 

Strong (+) 

3 

3 

Inappropriate behavior (reduction) 

1 (Mary) 

8 

Reversal-withdrawal 

Strong (+) 

3 

3 

Inappropriate behavior (reduction) 

1 (Todd) 

17 

Reversal-withdrawal 

Strong (+) 

3 

3 

Dunlap etal. (1995) b 

Problem behavior (reduction) 

1 (Jill) 

13 

Reversal-withdrawal 

No evidence 

2 

3 

Dunlap et al. (1996) 

Disruptive behavior (reduction) 

1 (Michael) 

7 

Reversal-withdrawal 

Strong (+) 

3 

3 

Disruptive behavior (reduction) 

1 (Gizelle) 

9 

Reversal-withdrawal 

Strong (+) 

3 

3 

Disruptive behavior (reduction) 

1 (Ann) 

7 

Reversal-withdrawal 

Strong (+) 

3 

3 
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Study characteristics 


WWC summary 







Intervention effects 

Outcome measure 

Sample 
size (case) 

Age(s) 

Design type 

Evidence level 

Total 

demonstrated 

Total 

attempted 

Hansen et al. (2014) c 

Disruptive behavior (reduction) 

1 (Isaac) 

12 

Reversal-withdrawal 

Strong (+) 

3 

3 

Disruptive behavior (reduction) 

1 (Jeremiah) 

7 

Reversal-withdrawal 

Strong (+) 

3 

3 

Disruptive behavior (reduction) 

1 (Ben) 

9 

Reversal-withdrawal 

No evidence 

1 

3 

Kern et al. (2001) 

Disruptive behavior (reduction) 

1 (Art) 

11 

Reversal-withdrawal 

No evidence 

0 

3 

Disruptive behavior (reduction) 

1 (Benjamin) 

11 

Reversal-withdrawal 

No evidence 

2 

3 

Losinski etal. (2015) d 

Disruptive behavior (reduction) 

1 (Alexandra, 
Peer 

separation) 

13 

Alternating treatment 

Strong (+) 

8 

8 

Disruptive behavior (reduction) 

1 (Brenda, 
Peer 

separation) 

13 

Alternating treatment 

Strong (+) 

8 

8 

Disruptive behavior (reduction) 

1 (Hannah, 
Peer 

separation) 

13 

Alternating treatment 

Moderate (+) 

6 

8 

Disruptive behavior (reduction) 

1 (Larry, Peer 
separation) 

14 

Alternating treatment 

Moderate (+) 

7 

8 

Disruptive behavior (reduction) 

1 (Alexandra, 
Teacher 
proximity) 

13 

Alternating treatment 

Moderate (+) 

4 

6 

Disruptive behavior (reduction) 

1 (Brenda, 
Teacher 
proximity) 

13 

Alternating treatment 

Strong (+) 

5 

5 

Disruptive behavior (reduction) 

1 (Hannah, 
Teacher 
proximity) 

13 

Alternating treatment 

No evidence 

3 

5 

Disruptive behavior (reduction) 

1 (Larry, 
Teacher 
proximity) 

14 

Alternating treatment 

No evidence 

3 

5 

Mustian (2001) e 

Off-task problem behavior 
(reduction) 

1 (Todd) 

11 

Reversal-withdrawal 

Strong (+) 

6 

6 

Off-task problem behavior 
(reduction) 

1 (Alan) 

11 

Reversal-withdrawal 

Strong (+) 

3 

3 


Table Notes: The WWC does not calculate effect sizes for single-case design research. Characterizations of Strong and Moderate evidence, based on WWC visual analysis, indicate 
that the experiment demonstrated an effect of the intervention. Characterizations of No evidence indicate that the experiment did not provide at least three demonstrations of an 
intervention effect in the same direction. + = a positive (favorable) effect in the desired direction. 

a For Davis et al. (201 2), the training phase is considered to be a part of the first functional communication training (FCT) intervention phase for the purposes of WWC visual analyses, 
as it was part of the functional behavioral assessment (FBA)-based intervention. After combining the training phase and first FCT phase into one phase, the visual analysis for each 
student/outcome focused on the first four phases (ABAB). Mary had five additional phases following the ABAB design that are not included in the visual analysis. Eli also had an 
additional phase (after the ABAB design) with a 60-second delay that is not included in the visual analysis. These phase changes are not of interest for this review because they do not 
compare the effect of an FBA-based intervention to a non -FBA-based intervention, but rather compare two FBA-based interventions. 
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b For Dunlap et al. (1 995), WWC visual analysis focused only on the first four phases (ABAB) that met WWC standards with reservations; in the second intervention phase, visual analy- 
ses focused on the first four data points before the baseline probe point. 

c Hansen et al. (201 4) used an ABCBCDC design for three students across two outcomes. The WWC visual analyses focused only on the BCBC phases of the reversal-withdrawal 
design (self-monitoring vs. FBA-based intervention plus self-monitoring [FBSM]). However, the study did provide data on additional phases: an initial baseline period, a phase of 
function-based consequences (FBC), and an additional FBSM phase. The design for the comparison between FBSM and FBC is not of interest for purposes of the WWC visual analyses 
because it does not compare the effect of an FBA-based intervention to a non -FBA-based intervention, but rather compares two FBA-based interventions. This comparison would 
also not meet WWC pilot single-case design standards because it has just two attempts to demonstrate an effect. For Ben, there were fewer than five data points in one phase, so his 
design meets WWC pilot single-case design standards with reservations. 

d For Losinski et al. (201 5), Hannah and Larry's experiments for the comparison between the Teacher proximity and comparison conditions were characterized as providing No 
evidence following WWC visual analysis. The WWC Procedures and Standards Handbook (version 3.0) characterizes experiments as providing Moderate evidence when the experiment 
has at least three demonstrations of an effect and at least one demonstration of a non-effect. However, in the case of alternating treatment designs, the data must also demonstrate 
no clear effects in the opposite direction and an overall mean level difference for each condition in order to be characterized as providing Moderate evidence. Both cases showed at 
least one effect in the opposite direction, so they were characterized as providing No evidence. 

e For Mustian (2001), the author used an ABABCBC design to examine the effect of both the FBA-based (B phase) and non- FBA-based (C phase) interventions on student behavior. The 
sequence of the interventions were modified for Alan, who received the non- FBA-based intervention (C phase) before the FBA-based intervention (B phase) (ACACBCB). The descrip- 
tions provided in the original study indicate little substantive difference between the non- FBA-based intervention and the baseline condition. Thus, for the purposes of the WWC visual 
analysis, Alan's baseline phases and non- FBA-based intervention phases are both treated as baseline phases, and compared to Alan's FBA-based intervention phases. 
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Appendix D: Single-case design findings in a domain not included in the effectiveness ratings 12 
Table D.l. Research details for single-case design studies with outcomes in the social-emotional 


competence domain 


Study 

Study sample, setting, comparison sessions, and intervention sessions 

Kern et al. (2007), Meets 

WWC Pilot Single-Case 

Design Standards With 
Reservations 

This study included two children (Beatriz and Sean) with selective mutism. Beatriz also had an emotional/behavioral 
disorder, and Sean was at risk for an emotional disturbance. Beatriz was 13 years old and in the eighth grade. Sean was 

11 years old and in the fourth grade. For Beatriz, the study took place during math, reading, and science in her special 
education classroom at an urban public middle school on the east coast. The study with Sean was conducted in his 
general education classroom in an urban public elementary school on the west coast, during language arts. 

Functional behavioral assessment (FBA) procedures for both students included review of records, observations, and 
interviews of parents, school staff, case workers, and students. The FBA-based interventions for both students consisted 
of having teachers ask questions in a way that required a verbal response, asking questions that were easy to answer, 
and notifying the student at the beginning of class how many questions would be asked. As a reward for meeting the 
day’s predetermined criterion, Sean could receive 5-10 minutes of extra recess time with a buddy. This reward was 
systematically faded. In addition, as part of an existing classwide reinforcement system, Sean also earned tickets that 
could be exchanged weekly for a prize from the class mystery box, if he met his daily criterion. Beatriz's intervention did 
not include a reward. During baseline, teachers implemented their regular procedures and did not ask questions that 
required vocal responses. 

For Beatriz and Sean, outcomes included independent and prompted vocal responses. Sean's spontaneous initiations 
were also measured. All three measures fall under the social-emotional competence domain. For a more detailed 
description of these outcome measures, see Appendix D, Table D.2. Maintenance data consisting of 1-2 data points 
were collected 2-4 weeks after the end of the intervention in each class for Beatriz and were collected 3 and 4 weeks 
after the end of Sean’s intervention. 

In both students’ changing criterion designs (across outcomes), there were fewer than five data points in at least one 
phase, so this study meets WWC pilot single-case design standards with reservations. 

Lane et al. (2007a), Meets 
WWC Pilot Single-Case 

Design Standards Without 
Reservations 

This study included one student (Claire) who had an outcome in the social-emotional competence domain. Claire was a 
7-year-old first-grade student who had high levels of internalizing behavior and was at risk for emotional and behavioral 
disorder (EBD) classification. In the classroom, Claire seldom interacted with others, did not participate in class discus- 
sions, and struggled to respond to teacher questions. The study took place in a general education classroom at an 
elementary school in a rural Tennessee school district. 

FBA procedures, including teacher and parent interviews, behavior rating scales completed by teachers, and direct 
observations, determined that Claire's nonparticipation typically occurred during instruction periods where students were 
asked to respond in front of their peers, and that Claire was anxious about providing wrong answers in front of her teacher 
and peers. Claire’s FBA-based intervention involved Claire and her teacher setting a goal each morning for the number 
of times she would participate during each whole-class activity. Examples of participation and nonparticipation were 
modeled to Claire until she could identify the two behaviors and demonstrate them on her own. Claire was allowed a break 
from participation and from teacher and peer attention once she met her daily goal, but was no longer allowed to escape 
teacher and peer attention by displaying nonparticipation. The baseline condition consisted of regular classroom practices. 

Claire’s outcome is the number of occurrences of participation during an academic task which falls under the social- 
emotional competence domain. For a more detailed description of this outcome measure, see Appendix D, Table D.2. 
Claire’s teacher participated in an initial 6-hour training workshop that provided explicit instruction and examples of the 

FBA procedures, followed by 1-hr weekly follow-up meetings. Claire's teacher was also trained to implement reinforcement 
and elimination of nonparticipation. Maintenance data were collected 3 weeks following the completion of the intervention. 
During the maintenance phase, regular classroom practices were used to determine whether the behavior remained once 
the intervention was concluded and whether the maximum daily objective was achieved. The number of occurrences of 
participation remained high, with an increasing trend. For more information about this study, see Appendix A.5. 


Study sample, setting, comparison sessions, and intervention sessions 
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Study 


Study sample, setting, comparison sessions, and intervention sessions 


Lane et al. (2007b), Meets 
WWC Pilot Single-Case 
Design Standards Without 
Reservations 21 


This study included one student (Margaret) with an outcome in the social-emotional competence domain. Margaret was 
at risk for emotional or behavioral problems and was not receiving special education services at the time of the study. Her 
study took place in a second-grade classroom (22 students) at an inclusive public school in middle Tennessee. 

The results of the FBA suggested that Margaret engaged in negative social interactions to gain peer attention during 
seatwork. Her FBA-based intervention involved a self-monitoring checklist as well as a prompt card with examples of 
positive social comments to use during the class period. She was then paired with a peer assistant who tallied Margaret's 
positive and negative social behaviors. Margaret would set a daily goal of positive comments, and if she reached her goal 
at the end of the day, Margaret was allowed to serve as the teacher’s assistant at the end of the day. Throughout the day, 
the teacher provided positive reinforcement when Margaret exhibited positive behavior, and only provided simple redirec- 
tion when negative behavior was displayed. Margaret's study used a reversal-withdrawal design with four phases and 
fewer than five data points in one of the phases; because all phases have at least three data points (rather than five), the 
design meets WWC pilot single-case design standards with reservations. During the baseline/withdrawal sessions, regular 
classroom practices were implemented in a 90-minute period in the morning. In that period, students were to complete 
three “center” assignments, while the teacher met with each reading group for 30 minutes. Students sat in groups of four 
and were allowed to talk quietly if they needed help completing the assignments. If a student exhibited negative behavior, 
the student had to “move their star” that was visible by the classroom; as the stars moved downward, privileges were lost. 


The outcomes for Margaret were negative social interactions and positive social interactions, which fall under the social- 
emotional competence domain. For a more detailed description of these outcome measures, see Appendix D, Table D.2. 
For more information about this study, see Appendix A. 6. 


Table D.2. Outcome measures in single-case design studies for the social-emotional competence domain 


Social-emotional competence 

Independent vocal responses 

The frequency of independent vocal responses to teacher questions observed during 5-minute intervals. An independent 
vocal response was defined as an appropriate vocal response provided within 30 seconds following the question, audible 
from a distance of five meters. Intervals spanned the length of the class period, which ranged from 30-50 minutes (as 
cited in Kern et al., 2007). a 

Negative social interactions 

The rate of negative social interactions observed during 30-minute observation sessions. Negative social interactions were 
defined as any behavior that was negative in voice or action toward peers, such as telling peers what to do when they 
had not asked or rolling eyes at peers. Data were collected two to three times a week using event recording, whereby the 
number of negative social interactions were tallied and converted to a rate (as cited in Lane et al., 2007b), a 

Participation during an academic 
task 

The number of times the student participated during a 30-minute observation session. Participation was defined as 
providing a verbal or non-verbal response to a teacher or a peer, such as verbally answering the teacher’s questions, 
raising one’s hand, or contributing information during a lesson. Examples of nonparticipation included keeping hands down 
and not speaking at all during a lesson (as cited in Lane et al., 2007a). 

Positive social interactions 

The rate of positive social interactions observed during 30-minute observation sessions. Positive social interactions were 
defined as any positive statement toward peers, such as praise statements or helpful comments. Data were collected two 
to three times a week using event recording, whereby the number of positive social interactions were tallied and converted 
to a rate (as cited in Lane et al., 2007b). a 

Prompted vocal responses 

The frequency of prompted vocal responses to teacher questions observed during 5-minute intervals. If the student did not 
provide a response to the teacher within 30 seconds of the question, the teacher issued a prompt by repeating the ques- 
tion, simplifying the question, or directing the student to verbally ask a peer for help with the answer. A prompted vocal 
response was defined as an appropriate vocal response provided within 30 seconds of a teacher prompt, audible from a 
distance of five meters. Responses did not need to be accurate to be counted. Intervals spanned the length of the class 
period, which ranged from 30-50 minutes (as cited in Kern et al., 2007). a 

Spontaneous initiations 

The frequency of spontaneous initiations observed during 5-minute intervals. A spontaneous initiation was defined as 
any spontaneous vocal utterance audible from a distance of five meters. Intervals spanned the length of the class period, 
which ranged from 30-50 minutes (as cited in Kern et al., 2007). a 


a The authors collected inter-assessor agreement (IAA) data in each phase and on at least 20% of all sessions, but it is not clear whether IAA data were collected during 20% of the 
data points in each condition. 
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Table D.3: Single-case design findings for the social-emotional competence domain 



Study characteristics 

WWC summary 

Outcome measure 

Sample size (case) 

Age(s) 

Design type 

Evidence level 

Kern et al. (2007) a 

Independent vocal responses 

1 (Beatriz, math) 

13 

Changing criterion 

Strong (+) 

Independent vocal responses 

1 (Beatriz, reading) 

13 

Changing criterion 

Strong (+) 

Independent vocal responses 

1 (Beatriz, science) 

13 

Changing criterion 

Strong (+) 

Prompted vocal responses 

1 (Beatriz, math) 

13 

Changing criterion 

No evidence 

Prompted vocal responses 

1 (Beatriz, reading) 

13 

Changing criterion 

No evidence 

Prompted vocal responses 

1 (Beatriz, science) 

13 

Changing criterion 

No evidence 

Independent vocal responses 

1 (Sean, language arts) 

11 

Changing criterion 

No evidence 

Prompted vocal responses 

1 (Sean, language arts) 

11 

Changing criterion 

No evidence 

Spontaneous initiations 

1 (Sean, language arts) 

11 

Changing criterion 

No evidence 

Lane et al. (2007a) 

Participation during an academic task 

1 (Claire) 

7 

Changing criterion 

No evidence 

Lane etal. (2007b) b 

Negative social interactions (reduction) 

1 (Margaret) 

7 

Reversal-withdrawal 

Strong (+) 

Positive social interactions 

1 (Margaret) 

7 

Reversal-withdrawal 

Strong (+) 


Table Notes: The WWC does not calculate effect sizes for single-case design (SCD) research. Characterizations of Strong and Moderate evidence, based on WWC visual analysis 
indicate that the experiment demonstrated an effect of the intervention. Characterizations of No evidence indicate that the experiment did not provide at least three demonstrations 
of an intervention effect in the same direction. + = a positive (favorable) effect in the desired direction. The evidence from the SCD studies on FBA does not reach the threshold to 
include SCD evidence in the effectiveness ratings for the social-emotional competence domain. 

a In Kern et al. (2007), Beatriz’s changing criterion designs were nested within a multiple baseline design across classes, but the WWC review focuses separately on the three 
changing criterion designs instead of the multiple baseline design, as the study authors primarily discussed the results from the changing criterion design. The WWC rating would 
be the same regardless of which design was reviewed. 

b In Lane et al. (2007b), Margaret's design had fewer than five data points in one phase, so her experiment meets WWC pilot single-case design standards with reservations. 


Functional Behavioral Assessment-based Interventions December 201 6 


Page 65 



WWC Intervention Report 


Endnotes 

1 The descriptive information for this intervention was obtained from Gresham et al. (2001); Hanley et al. (2003); and Iwata et al. (1994). 
Further verification of the accuracy of the descriptive information for this intervention is beyond the scope of this review. Full citations: 
Gresham, F. M., Watson, T. S., & Skinner, C. H. (2001). Functional behavioral assessment: Principles, procedures, and future directions. 
School Psychology Review, 30(2), 156-172; Hanley, G. P., Iwata, B. A., & McCord, B. E. (2003). Functional analysis of problem behavior: 

A review. Journal of Applied Behavior Analysis, 36(2), 147-185; Iwata, B. A., Dorsey, M. F., Slifer, K. J., Bauman, K. E., & Richman, G. S. 
(1994). Toward a functional analysis of self-injury. Journal of Applied Behavior Analysis, 27(2), 197-209. 

2 The literature search reflects documents publicly available by December 2015. The studies in this report were reviewed using the 
Standards from the WWC Procedures and Standards Handbook (version 3.0), and the Children Identified With or At Risk for an 
Emotional Disturbance topic area review protocol (version 3.0). The evidence presented in this report is based on available research. 
Findings and conclusions may change as new research becomes available. 

3 All single-case design experiments within a research article comprise one single-case design study. 

4 For the social-emotional competence domain, there are three studies (fewer than the five required), two different research teams 
with no overlapping authorship (fewer than the three required), and four cases (fewer than the 20 required). 

5 Please see the Children Identified With or At Risk for an Emotional Disturbance review protocol (version 3.0) for a list of all the 
outcome domains. 

6 For criteria used in the determination of the rating of effectiveness for single-case design studies, see the WWC Rating Criteria 
on p. 68. 

7 Skinner, B. F. (1953). Science and human behavior. New York, NY: Free Press. 

8 Dunlap, G., Kern, L., dePerczel, M., Clarke, S., Wilson, D., Childs, K. E., White, R., & Falk, G. D. (1993). Functional analysis of class- 
room variables for students with emotional and behavioral challenges. Behavioral Disorders, 18, 275-291 . 

9 Kern, L., Dunlap, G., Clarke, S., & Childs, K. E. (1994). Student-assisted functional assessment interview. Diagnostique, 79(2-3), 
29-39. 

10 O’Neill, R. E., Horner, R. H., Albin, R. W., Sprague, J. R., Storey, K., & Newton, J. S. (1997). Functional assessment and program 
development for problem behavior: A practical handbook. Pacific Grove, CA: Brooks/Cole Publishing. 

11 Umbreit, J., Ferro, J., Liaupsin, C., & Lane, K. (2007). Functional behavioral assessment and function-based interventions: An effective, 
practical approach. Upper Saddle River, NJ: Prentice-Hall. 

12 The results from single-case design studies are not used to report an intervention effectiveness rating for an outcome domain 
unless the studies collectively meet the threshold criteria described on p. 68. The evidence from the single-case design studies 
on FBA does not reach the threshold to include single-case design evidence in the effectiveness ratings for the social-emotional 
competence domain. 

13 In single-case design research, a case, such as a student or classroom, is the unit of intervention administration and data analy- 
sis. A single-case design experiment is the examination of a single outcome measure repeatedly within and across different phases 
defined by the presence or absence of the intervention. There may be multiple experiments for a case if more than one outcome is 
examined, for example. All experiments within a research article comprise one single-case design study. 

14 When there is more than one single-case design experiment in a publication that does not meet WWC pilot single-case design stan- 
dards, the citation list reports the disposition code that applies to the majority of single-case designs in that publication. Some single- 
case designs within a given publication might not meet WWC pilot single-case design standards for reasons other than the one listed in 
the citation list. 

15 Single-case design studies typically assign participants a pseudonym; we use the pseudonyms provided by study authors in this 
report so that WWC ratings can be easily mapped to the correct single-case design in the original study. 

16 The experiment for one of the students (Clay), had only four data points per condition, so this experiment meets WWC pilot 
single-case design standards with reservations. 

17 Tapp, J. T., Wehby, J. H., & Ellis, D. (1995). MOOSES: A multi-option observation system for experimental studies. Behavior 
Research Methods, Instruments, & Computers, 27, 25-31 . 

18 The experiment for one of the students (Ben) used a reversal-withdrawal design with four phases and fewer than five data points 
in one phase; because all phases have at least three data points, the experiments for both of Ben’s outcomes meet pilot single- 
case design standards with reservations. 
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19 The experiment for Aaron used a reversal-withdrawal design with four phases and fewer than five data points in two of the phases; 
because all phases have at least three data points, the experiment meets WWC pilot single-case design standards with reservations. 
The experiment used with the other student, Claire, meets WWC pilot single-case design standards without reservations; however, the 
social-emotional competence domain does not reach the threshold to include single-case design evidence in the effectiveness ratings 
in this report, so her experiment is described in Appendix D. 

20 The experiment for one of the students (Margaret) used a reversal-withdrawal design with four phases and fewer than five data 
points in one of the phases; because all phases had at least three data points (rather than five), this experiment meets WWC pilot 
single-case design standards with reservations. 

21 Margaret’s study used a reversal-withdrawal design with four phases and fewer than five data points in one of the phases; because 
all phases had at least three data points (rather than five), the design meets WWC pilot single-case design standards with reserva- 
tions. The experiment used with the other student (Charlie), meets WWC pilot single-case design standards without reservations and is 
described in Appendix C. 

Recommended Citation 

U.S. Department of Education, Institute of Education Sciences, What Works Clearinghouse. (2016, December). 
Children Identified With or At Risk for an Emotional Disturbance topic area intervention report: Functional 
Behavioral Assessment-based Interventions. Retrieved from http://whatworks.ed.gov 
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WWC Rating Criteria 

Criteria used to determine the rating of a study that includes single-case design experiments 


Study rating 

Criteria 

Meets WWC pilot single- 
case design standards 
without reservations 

A single-case design study that provides strong evidence for assessing an intervention's effectiveness. 

Meets WWC pilot single- 
case design standards 
with reservations 

A study that provides weaker evidence for assessing an intervention’s effectiveness, such as a reversal-withdrawal 
design with three or four data points per phase. 

Table Note: Any exceptions to this standard are specified in the topic area review protocol. For example, extreme self-injurious behavior might warrant a lower threshold of only 
one or two data points. 

Criteria used to determine evidence of a causal relation in a single-case design experiment 

Evidence level 

Criteria 

Strong evidence of a 
causal relationship 

A single-case design study with at least three demonstrations of the intervention effect and no non-effects. 

Moderate evidence of a 
causal relationship 

A single-case design study with at least three demonstrations of the intervention effect and at least one non-effect. 

No evidence of a causal 
relationship 

A single-case design study with fewer than three demonstrations of the intervention effect. 

Criteria used to determine whether the body of single-case design evidence for an intervention is 
substantive enough to summarize as evidence of intervention effectiveness for a given domain 

Threshold to include 
single-case design evidence 

Criteria 

Threshold met 

At least five studies examining the intervention meet WWC pilot single-case design standards without reservations or 
meet WWC pilot single-case design standards with reservations, AND 

The single-case design studies are conducted by at least three different research teams with no overlapping author- 
ship at three different institutions, AND 

The combined number of cases (i.e., participants, classrooms, etc.) totals at least 20. 


Functional Behavioral Assessment-based Interventions December 201 6 


Page 68 







WWC Intervention Report 


WWC Rating Criteria 

Criteria used to determine the rating of effectiveness for an intervention based on single-case design research 


Rating of effectiveness 

Criteria 

Positive effects 

Across all single-case design experiments, at least 80% show positive effects, AND 

No single-case design experiment shows negative effects, AND 

At least one single-case design experiment meets WWC pilot single-case design standards without reservations. 

Potentially positive effects 

Across all the single-case design experiments, 51% to 79% show positive effects, AND 

No single-case design experiment shows negative effects. 

Mixed effects 

At least one single-case design experiment shows positive effects AND at least one single-case design experiment 
shows negative effects, OR 

At least one single-case design experiment shows positive or negative effects AND 50% or more show 
indeterminate effects. 

Potentially negative effects 

Across all the single-case design experiments, 51% to 79% show negative effects, AND 

No single-case design experiment shows positive effects. 

Negative effects 

Across all the single-case design experiments, at least 80% show negative effects, AND 

No single-case design experiment shows positive effects, AND 

At least one single-case design experiment meets WWC pilot single-case design standards without reservations. 

No discernible effects 

None of the single-case design experiments shows effects, either positive or negative. 


Notes: A single-case design experiment has all of the design elements required to meet WWC standards with or without reservations (such as three attempts to demonstrate an 
effect) and is presented as one experiment in a study. The WWC characterizes all single-case design experiments in the same research article as one study, and thus one study 
can have multiple single-case design experiments. For example, a study could include three separate ABAB design experiments for one student (across three different eligible out- 
comes) or could include three separate ABAB design experiments for three separate eligible students. If a study presents data for more than one outcome, the WWC classifies the 
single-case design for each outcome as a separate experiment. The WWC visual analysis characterizations of Strong and Moderate evidence indicate that the design demonstrated 
an effect of the intervention. A visual analysis rating of No evidence indicates that the experiment did not provide at least three demonstrations of an intervention effect in the same 
direction. 
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Alternating treatment 
design 

Attrition 


Baseline 

Case 

Clustering adjustment 

Confounding factor 

Design 

Domain 
Effect size 

Eligibility 

Equivalence 

Extent of evidence 

Fidelity 

Improvement index 

Intervention 


A single-case design experiment that repeatedly introduces and withdraws the intervention(s); 
each phase only lasts one or two sessions. 

For group design research, attrition occurs when an outcome variable is not available for all 
participants initially assigned to the intervention and comparison groups. The WWC consid- 
ers the total attrition rate and the difference in attrition rates across groups within a study. For 
single-case design research, attrition can occur when an individual fails to complete all required 
phases of a study or the case is a group and individuals attrite from the group. 

In a single-case design experiment, baseline is the condition when participants are not 
receiving the intervention. 

A case is the unit of intervention administration and data analysis in a single-case design experi- 
ment. A case may be a single participant or a cluster of participants like a classroom. 

In group design research, if intervention assignment is made at a cluster level and the 
analysis is conducted at the student level, the WWC will adjust the statistical significance to 
account for this mismatch, if necessary. 

A confounding factor is a component of a study that is completely aligned with one of the 
study conditions, making it impossible to separate how much of the observed effect was 
due to the intervention and how much was due to the factor. 

The design of a study is the method by which intervention and comparison groups were 
assigned (group design) or the method by which a dependent variable was repeatedly and 
systematically measured before, during, and after the active manipulation of an indepen- 
dent variable (single-case design). 

A domain is a group of closely related outcomes. 

The effect size is a measure of the magnitude of an effect. The WWC uses a standardized 
measure to facilitate comparisons across group design studies and outcomes. 

A determination of whether a study falls within the scope of a review protocol and uses a 
causal design. 

A demonstration that the analysis sample groups are similar on observed characteristics 
defined in the review area protocol. 

An indication of how much evidence from group design studies supports the findings. The 
criteria for the extent of evidence levels are given in the WWC Rating Criteria on p. 68. 

Fidelity indicates the extent to which the intervention, as implemented, replicates the inter- 
vention’s design. 

Along a percentile distribution of individuals, the improvement index represents the gain 
or loss of the average individual due to the intervention, using findings from group design 
research. As the average individual starts at the 50th percentile, the measure ranges from 
-50 to +50. 

An educational program, product, practice, or policy aimed at improving student outcomes. 
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Intervention report 


Maintenance probes 

Multiple baseline 
design 

Multiple comparison 
adjustment 

Multiple probe design 
Phase 

Quasi-experimental 
design (QED) 

Randomized controlled 
trial (RCT) 

Rating of effectiveness 


Reversal-withdrawal 

design 

Single-case design 
(SCD) experiment 

Standard deviation 


Statistical significance 


A summary of the findings of the highest-quality research on a given program, product, 
practice, or policy in education. The WWC searches for all research studies on an interven- 
tion, reviews each against design standards, and summarizes the findings of those that meet 
WWC design standards. 

In single-case design research, maintenance probes measure outcomes after the interven- 
tion has ended. 

A single-case design that staggers the introduction of the intervention to different cases or 
to the same case over different settings. 

When a group design study includes multiple outcomes or comparison groups, the WWC 
will adjust the statistical significance to account for the multiple comparisons, if necessary. 

A variation on the multiple baseline single-case design that features intermittent pre-inter- 
vention data collection. 

In single-case design research, phases are the consecutive sessions when a case receives 
or does not receive the intervention. 

A quasi-experimental design (QED) is a research design in which study participants are 
assigned to intervention and comparison groups through a process that is not random. 

A randomized controlled trial (RCT) is an experiment in which eligible study participants are 
randomly assigned to intervention and comparison groups. 

For group design research, the WWC rates the effectiveness of an intervention in each 
domain based on the quality of the research design and the magnitude, statistical signifi- 
cance, and consistency in findings. For single-case design research, the WWC rates the 
effectiveness of an intervention in each domain based on the quality of the research design 
and the consistency of demonstrated effects. The criteria for the ratings of effectiveness are 
given in the WWC Rating Criteria on p. 68. 

A single-case design that introduces the intervention twice and withdraws the intervention 
once (also known as an ABAB design). The design may be extended by adding additional 
baseline and/or intervention phases. 

A research approach in which an outcome variable is measured repeatedly within and 
across different conditions that are defined by the presence or absence of an intervention. 

The standard deviation of a measure shows how much variation exists across observations 
in the sample. A low standard deviation indicates that the observations in the sample tend 
to be very close to the mean; a high standard deviation indicates that the observations in 
the sample tend to be spread out over a large range of values. 

Statistical significance is the probability that the difference between groups is a result 
of chance rather than a real difference between the groups. The WWC labels a finding 
statistically significant if the likelihood that the difference is due to chance is less than 5% 
(p < .05). 
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Substantively important A substantively important finding is one that has an effect size of 0.25 or greater, regardless 

of statistical significance. 

Systematic review A review of existing literature on a topic that is identified and reviewed using explicit meth- 
ods. A WWC systematic review has five steps: 1) developing a review protocol; 2) searching 
the literature; 3) reviewing studies, including screening studies for eligibility, reviewing the 
methodological quality of each study, and reporting on high quality studies and their find- 
ings; 4) combining findings within and across studies; and, 5) summarizing the review. 


Threshold to include For single-case design studies to contribute to the evidence rating, there must be a suf- 
single-case design ficient combination of participants, authors, and studies that meet evidence standards. The 
evidence criteria for the threshold to include single-case design evidence are given in the WWC Rat- 
ing Criteria on p. 68. 


Visual analysis A visual analysis reviews the pattern of outcome data in a single-case design experiment to 
determine whether a positive effect, negative effect, or no effect is demonstrated between 
the intervention and the outcome. 


Please see the WWC Procedures and Standards Handbook (version 3.0) for additional details. 
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Intervention 

Report 



Practice 

Guide 



Quick 

Review 


Single Study 
Review 



An intervention report summarizes the findings of high-quality research on a given program, practice, or policy in 
education. The WWC searches for all research studies on an intervention, reviews each against evidence standards, 
and summarizes the findings of those that meet standards. 


This intervention report was prepared for the WWC by Mathematica Policy Research under contract ED-IES-13-C-0010. 
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